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1.0  INTRODUCTION 


Increasing  public  and  private  interest  in  government  regulotion  of  various  sectors  of  the 
economy  and  in  areas  of  public  activities  has  resulted  in  greater  attention  being  paid  to  the 
effects  of  such  regulotion.  Government  ogencies  are  now  largely  expected  to  justify  proposed 
regulations  ond  policies  with  studies  of  the  anticipated  benefits  and  costs,  monetory  and  other- 
wise, of  such  proposals. 

As  a federal  agency,  the  United  States  Coast  Guard  must  likewise  Justify  regulatory  proposals. 
Regulation  in  the  area  of  pleasure  boating  is  a particularly  sensitive  issue.  Not  only  is  there 
likely  to  be  public  opposition  to  the  regulation  of  recreotional  octivities,  but  the  economic 
impoct  on  the  boot  manufacturing  industry  also  must  be  carefully  considered. 

Because  of  this  sensitivity,  the  Coast  Guard  must  weigh  its  decisions  carefully,  perhaps  more 
coreful ly  than  those  of  other  agencies  which  have  to  deal  with  only  a few  large  manufacturers. 
The  Coost  Guord  requires,  therefore,  a relatively  sophisticated  methodology  for  assessing 
the  effectiveness  of  its  regulotory  proposals. 

Wyle  Loborotories  has  been  given  the  task  of  developing  for  the  Coast  Guard  a general  regula- 
tory effectiveness  methodology,  (Regulation  in  this  instance  meons  not  only  mandatory  require- 
ments of  boaters  or  manufocturers,  but  olso  education  programs,  changes  in  enforcement 
policies,  etc.  The  word  "regulation"  will  be  used  in  this  brood  sense  in  this  report.)  This 
methodology  must  include  techniques  both  for  estimating  the  benefits  and  costs  that  would 
result  from  a contemploted  regulation  and  for  assessing  or  tracking  the  benefits  and  costs 
resulting  from  a regulotion  after  it  has  been  implemented. 

Although  costing  methods  can  be  quite  complicated,  they  are  relatively  well-defined  os 
compared  with  methods  for  benefit  determination.  This  is  due  in  large  measure  to  differences 
in  the  types  of  dato  ovailable,  Monufacturers  usually  have  detailed  knowledge  of  their 
costs  and  can  make  good  engineering  judgments  of  what  costs  would  be  involved  in  the 
modlficotion  of  on  existing  product  or  the  manufocturing  of  a new  one.  Also,  after  a modified 
or  new  product  is  in  the  marketplace,  there  is  good  data  on  the  actual  costs  Incurred. 


1 


FT 


I 


Probably  the  greatest’  difficulty  in  cost  analysis  is  in  projecting  sales,  material  and  labor 
costs,  and  factors  related  to  the  value  of  money,  such  as  interest  rates.  These  aspects  are 
related  to  social  changes  and,  thus,  are  related  to  similar  problems  in  making  benefit 
predictions. 

The  onolysis  of  benefits,  however,  involves  additional  problems.  Full  data  on  the  number  of 
accidents,  the  number  of  victim  recoveries  and  a host  of  more  specific  factors  are  not  avail- 
oble.  Some  of  this  data  could  not  be  obtained  even  if  a perfect  accident  reporting  system 
were  possible.  For  instance,  there  would  be  no  way  of  determining  the  exact  number  of 
situations  in  which  an  accident  would  occur  were  it  not  for  the  effects  of  a regulation.  At 
first,  one  might  attempt  to  merely  compare  the  number  of  accidents  or  fatalities  occurring 
before  the  promulgation  of  a regulation  with  the  number  after  the  regulation  went  Into  effect. 

However,  such  an  analysis  does  not  take  into  account  the  unknown  change  in  boating  activity, 
including  accidents  and  fatalities,  that  would  have  occurred  if  the  regulation  had  not  been 
adopted.  While  there  is  no  means  of  absolutely  determining  exactly  what  such  changes  would 
have  been,  it  should  nevertheless  be  possible  to  develop  techniques  for  evaluating  regulatory 
benefits  incorporating  methods  for  estimating  such  changes. 

As  investigation  of  some  of  the  methods  heretofore  used  in  regulatory  effectiveness  studies 
progressed,  it  became  clear  that  it  would  be  necessary  to  devise  some  new  benefit  determi- 
nation methods  which  would  be  especially  applicable  to  the  sort  of  accident  data  available 
to  the  Coast  Guard.  Thus,  a substantial  part  of  Wyle's  effort  In  this  task  was  devoted  to 
developing  new  methods  for  predicting  and  assessing  (tracking)  benefits.  These  methods  are 
described  In  Sections  3.0  and  4.0  of  this  report. 

In  addition  to  having  oppropriote  mathematical  techniques  for  use  in  determining  benefits,  it 

is  also  necessory  that  available  data  be  properly  evaluated  and  structured  so  as  to  be  amenable 

to  mathematical  and  other  analyses.  This  procedure  Is  often  referred  to  as  modeling,  although 

it  octually  is  the  development  of  o data  base  and  not  a true  mathematical  modeling  effort.  < 

The  Accident  Recovery  Model  (Reference  1),  developed  during  the  seme  period  that  the  work  on 

this  task  was  being  performed,  is  a good  example  of  such  a data  base.  As  a result  of  the  experience 
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gained  in  developing  ARM  and  other  models,  as  well  as  work  in  this  task,  it  has  been  possible 
to  develop  a set  of  guidelines  for  data  base  model  development  using  Coast  Guard  accident 
data.  These  guidelines  are  presented  In  the  next  section. 


It  should  be  recognized  that  the  methods  presented  in  this  report  are  preliminary  in  nature. 
Ongoing  research  will  result  in  the  refinement  of  these  methods  or  the  replacement  of  them 
by  better  ones.  Furthermore,  the  reader  should  be  aware  that  the  methods  ore  not  necessarily 
presented  in  this  report  in  the  some  order  in  which  they  might  be  applied.  The  reader  is 
referred  to  Section  5.1  for  o description  of  o possible  procedure. 
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2.0  DATA  EVALUATION  AND  STRUCTURING  (MODELING) 


2.1  IntroducHon 


In  order  for  the  Coast  Guard  to  determine  how  effective  a contemplated  regulation  might  be 
or  a promulgated  regulation  has  been,  it  is  necessary  for  it  to  hove  information  on  how  many 
Occidents  and  victims  the  regulotion  might  affect.  In  order  to  obtain  this  information,  it  is 
necessary  that  a structured  analysis  of  accidents  be  performed.  Such  data  analyses  may  be 
classified  into  two  categories: 


analyses  performed  to  determine  the  effectiveness  of  a specific  regulation,  and 
an'T/ses  performed  on  a general  class  of  accidents  or  accident  recovery  for  use 
in  evaluating  any  regulation  designed  to  affect  the  class. 


An  example  of  the  ^rst  type  of  analysis  is  that  performed  by  Operations  Research  Inc.  in  the 
analysis  cf  bridge-to-bridge  radio  telephones  (Reference  2).  In  that  analysis,  a structured 
series  of  questions  called  a Casualty  Analyses  Gauge  (CAG)  was  used  to  evaluate  accident 
reports  to  determine  if  the  use  of  bridge-to-bridge  rodio  telephones  possibly  could  hove 
prevented  the  accident,  or  if  they  were  used  and  should  have  prevented  the  accident,  but 
didn't.  A sample  of  collision  accident  reports  was  chosen  and  each  accident  was  analyzed 
using  the  CAG.  The  results  were  then  summarized  by  two  criteria:  1)  radio  telephone  used 
or  not  used,  and  2)  radio  telephone  potentially  could  or  could  not  have  prevented  the  accident. 
Statistical  methods  were  then  applied  to  the  data  in  an  attempt  to  determine  if  the  regulation 
requiring  bridge-to-bridge  radio  telephones  was  beneficial  in  reducing  accident  occurrences. 


The  Accident  Recovery  Model,  ARM  (Reference  1),  is  an  example  of  the  second  type  of  accident 
analysis.  A sample  of  all  types  of  recreationol  boating  accidents  was  chosen  and  analyzed  using 
a structured  series  of  trees  and  coding  definitions  designed  to  evaluate  the  post-accident  actions 
of  accident  victims  and  the  conditions  they  encountered.  The  results  of  the  analysis  were  then 
adjusted  to  reflect  the  statistics  for  all  reported  recreational  boating  accidents  as  found  in 
CG-357.  This  type  of  analysis  not  only  can  be  used  in  evaluating  the  effectiveness  of 
regulations,  but  it  can  also  be  used  to  determine  if  a problem  area  exists  which  might  benefit 
from  regulation  . 
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Before  discussing  ony  particular  data  analysis  in  depth,  it  seems  appropriate  to  give  some 
general  guidelines  for  developing  such  an  analysis  so  that  the  evaluation  of  accident  reports 
and  the  structuring  of  the  data  will  be  efficiently  performed.  We  begin  the  discussion  of 
this  topic  in  the  following  section, 

2.2  Initial  Steps  in  Developing  a Date  Base  Model 

The  suggested  procedure  described  in  the  following  paragraphs  is  the  result  of  experience 
gained  in  the  development  of  a number  of  data  base  models.  It  is  expected  that  further 
experience  will  lead  to  refinements  and/or  changes  In  this  suggested  guideline. 

As  a first  step,  at  least  one  and  preferably  two  analysts  should  read  a variety  of  accident 
reports  covering  the  subject  to  be  analyzed.  The  reports  read  should  include  all  types  from 
simple  BARs  to  MIO  reports  to  in-depth  reports,  including  some  with  supplementary  materials 
such  as  newspaper  reports.  This  will  give  the  analysts  a better  feeling  for  the  nature  of  the 
subject  (e.g, , collisions)  and  for  the  types  of  information  ovailable  to  him.  Naturally,  it  is 
best  if  at  least  one  of  the  analysts  has  had  previous  experience  in  analyzing  and  in  investigating 
boot!  ng  acci  dents . 

After  the  analysts  become  familiar  with  the  accident  type(s)  and  the  kinds  of  data  avoilable, 
they  should  identify  the  factors  they  believe  to  be  importont.  For  example,  in  the  case  of 
victim  recovery,  the  condition  of  the  boat,  PFD  wear,  and  swimming  ability  would  be  a few 
of  the  important  factors.  A structured  data  analysis  form  can  then  be  constructed  which 
Includes  these  factors.  The  structured  form  may  be  a series  of  relevant  questions,  an  event 
tree,  or  both.  Experience  seems  to  indicate  that  event  trees  are  very  useful  at  this  stage. 

They  help  organize  and  direct  the  analysts'  thoughts  and  help  assure  consistent  evaluations 
(codings)  of  accident  reports.  If  carefully  developed,  they  also  help  in  coding  incomplete 
doto  in  the  mony  instonces  when  fully  detailed  reports  are  unavailable. 

Once  the  analysts  are  satisfied  with  the  structured  data  analysis  form  they  have  developed, 
they  should  use  the  form  to  evaluate  a number  of  accident  reports.  Two  analysts  should  be 
involved  in  this  step,  and  at  leost  30  reports  of  various  types  (BAR  to  in-depth)  should  be 
exomined.  At  this  stage,  the  coders  will  likely  encounter  many  problems.  Important  factors 
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[ may  be  found  to  have  been  left  out  of  the  data  analysis  form,  decisions  on  what  actually 

[ occurred  in  the  accident  will  have  to  be  made,  the  problem  of  missing  data  will  have  to  be 

[.  attacked  and  fuzzy  definitions  and  questions  will  have  to  be  made  more  precise.  The 

[ analysts  should  interact  closely  at  this  stage,  making  modifications  in  their  accident  analysis 

I techniques  as  the  evaluation  of  the  sampled  accident  reports  progresses. 

It  is  almost  a certainty  that  the  analysts  will  encounter  at  least  a few  accidents  which  can  be 
I evaluated  without  too  much  difficulty,  but  for  which  the  evaluation  does  not  seem  to  adequately 

j describe  the  circumstances  of  the  accident  — the  evaluation  doesn't  "feel"  right.  This  is  most 

likely  to  occur  when  the  circumstances  involved  are  complex.  If  this  happens  in  only  one  or 
two  cases,  there  probably  is  nothing  wrong,  at  least  nothing  serious,  provided  it  isn't  dis- 
covered that  an  important  factor  has  been  left  out  of  the  structured  analysis  form, 
t 

However,  if  this  problem  occurs  often,  the  analysts  should  discuss  it  thoroughly  and  attempt 
to  make  adjustments  to  their  evaluation  methods  to  reduce  the  problem.  Discussion  with  a 
third  party  can  be  valuable  in  this  circumstance. 

After  the  analysts  have  completed  this  preliminary  accident  sample  evaluation,  they  should 
examine  the  results,  including  the  changes  that  hove  taken  place  in  the  structured  analysis 
form.  If  they  feel  that  they  now  have  developed  their  evaluation  method  sufficiently  to 
evoluate  a large  somple,  they  are  ready  to  proceed  to  the  next  step.  If  they  are  still  un- 
satisfied with  their  evaluation  method,  or  if  their  preliminary  accident  analysis  resulted  in 
major  changes  in  their  evaluation  criterio,  then  they  should  probably  go  through  a second 
preliminary  accident  sample  evaluation,  using  revised  methods. 

Once  satisfied  with  their  accident  report  evaluation  method,  the  analysts  are  then  ready  to 
adopt  a format  for  their  major  accident  evaluation  effort.  This  should  be  in  the  form  of  a j 

data  base.  That  is,  data  should  be  coded  in  such  a manner  that  any  needed  item  of  data  is 
'■  retrievable.  Thus,  unlike  ARM^  (Reference  I)  in  which,  for  example,  it  is  only  possible  to 

retrieve  information  on  the  swimming  abilities  of  victims  who  have  no  flotation  aids,  the  format 
; should  allow  retrieval  of  all  Information,  in  this  instance,  on  the  swimming  ability  of  all 

■ victims,  or  ot  least  all  those  for  whom  swimming  ability  could  possibly  have  influenced  recovery, 

I Date  for  eoch  accident  or  accident  victim  (whichever  is  appropriate)  should  be  coded  separately; 
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rother  then  coding  summary  doto  (f-ol-ols,  overoges,  etc.)  in  place  of  the  individual  data.  In 
this  way,  the  data  con  be  later  monipulated  in  whatever  manner  desired  and  the  data  base  con 
be  expanded  by  coding  additional  accidents  and/or  victims. 


The  implementation  of  the  data  base  approach  will  make  the  use  of  a single  event  tree  impos- 
sible, or  virtually  so.  Such  a tree  would  have  to  be  very  large  and  redundant,  having  many 
branches  with  identicol  nodes,  or  it  would  not  provide  the  flexibility  needed  in  order  for  all 
of  the  data  to  be  coded,  e.g.,  the  example  of  swimming  ability  cited  above.  It  may  be 
possible,  however,  to  use  a series  of  small  trees,  each  covering  a single  aspect  of  the  accident 
or  recovery,  V/hichever  method  is  used,  a series  of  small  trees  or  a series  of  individual 
questions,  the  analysts  should  check  to  be  sure  that  the  data  is  coded  in  such  a manner  that 
each  piece  of  date  is  individually  retrievable.  Definitions  ond  questions  should  then  be  very 
carefully  and  completely  expressed  in  written  form.  Because  data  results  may  be  significantly 
different  for  serious  Occidents  as  opposed  to  non-serious  ones,  the  data  coded  for  each  acci- 
dent or  victim  should  include  whether  or  not  the  accident  involved  a fatality,  serious  injury, 
or  significant  property  damage,  as  well  os  weather  and  water  conditions. 

In  selection  a somple  of  Occident  reports,  the  analysts  may  very  likely  wish  to  stratify  the 
sample  occording  to  some  parometers  rather  than  to  select  a completely  random  sample.  For 
example,  if  the  data  will  be  used  to  investigate  a pre-  vs.  post- regulatory  activity,  then  the 
onalysts  will  wont  to  select  reports  of  accidents  from  particular  years.  They  may  also  wish 
to  strotify  the  selection  by  such  foctors  os  Occident  type,  boat  type,  etc.  Whatever  stratifi- 
cation criteria  are  selected,  the  analysts  must  decide  on  the  number  or  proportion  of  reports 
to  be  selected  in  each  category.  Within  these  constraints,  the  report  selection  should  be 
random. 

Two,  or  preferably  three,  individuals  should  be  used  to  evaluate  and  code  the  sampled  acci- 
dent reports.  At  least  one  of  the  original  analysts  should  remain  involved,  either  as  one  of  the 
evaluators  and  coders,  or  at  least  as  a reference  source  when  questions  arise.  When  such 
questions  do  arise,  the  clarifications  should  be  provided  to  all  coders.  At  least  two  individuals 
should  independently  evaluate  and  code  every  accident.  The  coding  should  be  done  directly 
onto  computer  coding  sheets  to  eliminate  transcription  errors.  A "hard"  copy  should  be  made 
of  every  evaluated  report,  and  a file  should  be  kept  of  all  such  reports  with  a reference 
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numbering  system  so  that  the  computer  coded  data  can  be  matched  to  the  report.  This  will 
focilitate  the  rechecking  of  analyses  if  such  should  be  necessary  and  will  allow  for  the  collection 
of  odditional  data  on  each  accident,  when  needed. 

After  the  accident  reports  hove  been  evaluated  and  coded  by  at  least  two  individuals  working 
independently,  the  results  should  be  compared.  Disagreements  should  be  worked  out  in  con- 
sultations among  the  coders  involved,  and  if  any  uncertainties  remain,  they  should  be  discussed 
in  a meeting  of  all  coders,  including  the  analyst  who  has  acted  as  a reference  source.  This 
i analyst  should  also  have  randomly  checked  accident  evaluations  to  insure  that  the  reports  are 

being  properly  evaluated.  Any  disagreements  which  cannot  be  worked  out  should  be  coded 
"unknown . " 

Two  final  caveats  with  regard  to  coding:  There  may  be  a strong  desire  to  use  the  coding  "not 
applicable"  In  some  circumstances.  This  desire  should  be  strongly  restrained.  Any  use  of 
"not  applicable"  should  be  restricted  to  very  specific  circumstances.  It  is  better  to  code  all 
data,  using  "unknown"  if  necessory,  so  that  in  the  future  an  analyst  can  decide  for  himself 
if  any  data  is  not  applicable.  The  second  caveat  regards  the  coding  of  corrections  and  final 
decisions  when  disagreements  occur.  One  and  only  one  copy  of  the  coding  sheets  should  be 
prominently  labeled  as  the  "Corrected  Copy."  This  should  help  reduce  the  likelihood  of  some 
corrections  or  changes  not  being  included  becouse  of  more  than  one  copy  being  used  for 
agreed-on  corrections. 


2.3  Weighting  the  Sample  Data 

In  order  to  adjust  the  frequencies  in  a data  base  of  sampled  accident  reports  to  reflect  Coast 
Guord  stotistics  for  oil  reported  accidents,  it  is  necessory  to  use  weighting  factors.  Also, 
even  randomly  chosen  or  carefully  stratified  samples  will  show  some  variation  in  relative 
frequencies  when  compared  with  the  actual  population  from  which  the  sample  is  drawn. 

This  variation  can  be  reduced  by  careful  choice  of  weighting  factors.  It  should  be  emphasized 
that  weighting  factors  are  used  only  to  adjust  the  accident  sample  to  reflect  certain  known, 
well-defined  accident  population  statistics,  such  as  numbers  of  fatalities.  They  are  not  used 
to  odjust  for  ill-defined,  or  unknown,  but  estimated  or  desired  accident  population  characteristics. 
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One  first  must  decide  on  the  parameters  on  which  weighting  should  be  based.  This  will  depend 
on  which  are  felt  to  be  most  important.  Fatalities  almost  certainly  will  be  included.  Accident 
type,  boat  type  and  boat  length  are  also  likely  to  be  considered  important.  Whichever  para- 
meters are  chosen,  it  will  be  necessary  to  hove  motrices  of  frequencies  for  all  combinations 
of  parameter  values,  each  parameter  corresponding  to  one  dimension  of  the  matrix.  One  of 
these  matrices  will  be  of  population  frequencies,  the  other  of  sample  frequencies,  A matrix 
of  weights  can  then  be  obtained  by  dividing  each  population  frequency  by  the  corresponding 
sample  frequency.  Mathematically, 


W,.  = ^ , S,.  ^ 0, 

IJ  S,,  II 


where  W..  is  the  weight  in  the  i,j  - position  of  the  weight  matrix  W,  and  P..  and  S..  are  the 
frequencies  in  the  i,j  - positions  of  the  population  and  sample  frequency  matrices,  P and  S, 
respectively. 

In  certain  instances,  the  matrix  S of  sample  frequencies  will  contain  a zero  entry  while  the 
corresponding  entry  in  the  matrix  of  population  frequencies  P is  non-zero.  This  normally 
will  occur  only  when  the  population  frequency  entry  is  small,  so  that  the  likelihood  of  a 
sampled  accident  being  chosen  with  the  given  characteristics  is  small.  In  such  a case  any 
value  for  the  weight  could  be  entered  in  W as  that  weight  would  never  be  used.  It  is 
suggested  that,  as  one  check  on  the  weighting  program,  a very  large  negative  number  be 
entered.  Then  if  the  weight  is  incorrectly  used,  such  use  will  be  obvious  from  the  negative 
adjusted  frequencies  obtoined. 

If  an  entry  of  S is  zero  while  the  corresponding  entry  P..  of  P is  non-zero,  the  above 
weighting  procedure  will  not  include  the  frequency  P.,  in  arriving  at  adjusted  frequency 
totals,  and  such  totals  will  therefore  be  smeller  than  the  actual  frequency  totals.  If  this 
is  undesirable,  the  following  alternatives  are  suggested: 
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If  the  category  with  no  sample  data  is  considered  important,  the  Coast  Guard 
data  bank  can  be  searched  for  the  relevant  accidents  in  order  to  obtain  the 
case  numbers  of  the  accidents.  The  accident  reports  can  then  be  located 
and  added  to  the  sample.  This  will  result  in  a revised  matrix  S of  sample 
frequencies  and  a corresponding  revised  weight  matri  X W. 

To  merely  make  a final  adjustment  of  frequencies  to  bring  the  weighted  sample 
frequencies  up  to  the  population  frequencies,  each  computed  weighted 
frequency  can  be  multiplied  by; 


a = 


- iJ 


P.. 

'J 


E W..  S.. 

ij  'J  'J 


S..  0 

•J 


That  is,  by  the  ratio  of  the  total  population  frequency  to  the  adjusted  sample 
irequency  (adjusted  by  using  weights  derived  from  non-zero  values  of  S..). 

In  effect,  this  treats  subcategories  for  which  there  are  no  sample  reports  as 
being  an  "average"  of  all  sampled  accidents. 

• A procedure  similar  to  the  preceedi ng  can  be  performed  with  the  adjustments 
being  made  within  only  some  categories  (e.g,,  fires)  rather  than  overall. 

In  effect,  this  treats  a subcategory  (e.g.,  fires  on  sailboats)  for  which  there 
are  no  sample  reports  as  being  on  "average"  of  all  sampled  accidents  in  the 
category  (fires)  containing  that  particular  subcategory. 

The  latter  two  procedures  may  both  introduce  considerable  error  if  the  accident  subcategories 
Involved  have  relatively  large  frequencies  (P..)  in  the  accident  population  or  differ  significantly 
from  "average"  sampled  accidents. 
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The  actual  computation  of  the  weights  could  be  performed  on  the  computer.  If  the  Coast 
Guard  data  base  of  all  reported  and  coded  accidents  is  available  in  memory,  the  matrix  P of 
accident  population  frequencies  con  be  constructed  by  making  tabulations  of  the  number  of 
population  accidents  corresponding  to  particular  parameter  values.  Otherwise,  the  matrix  P 
must  be  obtained  from  another  source,  probably  CG-357,  ond  entered  Into  computer  memory. 

A computer  program  is  then  used  to  tabulate  the  number  of  sample  Occidents  corresponding  to 
particular  oarometer  values,  thus  constructing  the  matrix  S,  and  finally  the  matrix  W of  weights 
is  computed . 

In  the  case  of  models  in  which  victims  are  individually  accounted  for,  the  weighting  will 
normally  apply  to  victims  rather  than  to  accidents.  No  tabulation  is  kept  on  the  total  number 
of  victims  involved  in  reported  Occidents;  only  injured  victims  and  fatalities  are  tobulated. 

The  population  frequencies  must  therefore  be  estimated  from  the  sample  victim  frequencies. 

An  overall  estimate  or  a category-by-category  estimate  can  be  obtained  using  the  numbers  of 
people  on  board.  Thus, 

^ , ...  . ..  r / sample  victim  frequency  \ , population  , 

estimated  population  victim  frequency  = ( i — i r-f — • ( i , r 

\ sample  boat  frequency  / \ boat  frequency/. 

The  number  of  survivors  or  non-injured  victims  can  then  be  estimated  by  subtracting  from  this 
number  the  number  of  fatalities  or  injured  victims,  respectively,  adjusting  where  necessary  for 
victims  in  the  water  who  were  not  on  a boat. 


The  computer  program  should  contain  a subroutine  to  apply  the  weights  as  part  of  a sorting 
routine  in  the  following  monner.  In  sorting,  when  on  accident  (or  victim)  meets  the  sort 
criterio,  the  oppropriote  weight  is  selected  from  W and  the  tabulation  totals  are  incremented 
by  this  weight,  rather  than  by  "one."  Thus,  in  effect,  each  sample  accident  (or  victim)  in 
the  i,j  - category  is  counted  as  W..  population  accidents  (victims)  in  that  category. 

Because  it  is  importont  to  be  able  to  update  the  data  base  and  to  account  for  changes  in  the 
Occident  population,  the  above  described  method  of  opplying  the  weights  is  oppropriote.  The 
oltemotive  would  be  to  reploce  eoch  accident  (victim)  entry  in  the  data  base  with  its  appro- 
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priafe  weighf"  and  f'hus  be  able  to  I’abulai'e  weights  directly.  However,  this  would  make  data 
updating  more  difficult  as  well  as  requiring  more  storage  space  for  the  extra  digits  needed  in 
each  data  entry.  For  the  most  efficient  updating  of  data,  a computer  routine  for  recomputing 
the  matrices  P,  S and  Wshould  be  available. 

2.4  Model  Integration  — Developing  an  Overall  Data  Base  Model 

One  of  the  requirements  of  a complete  program  of  regulatory  effectiveness  analysis  is  a data 
base  model  covering  all  important  accident  types  as  well  as  post-accident  victim  recovery. 
Data  analyses  of  the  type  previously  discussed  should  be  performed  in  at  least  each  of  the 
following  areas: 

• accident  recovery  (the  Accident  Recovery  Model  currently  under  development), 

• collisions,  including  groundings,  and  two-boat,  fixed  object  and  floating 
object  collisions, 

• caps! zings,  swampings,  and  sinkings, 

• fires  and  explosions, 

• falls  overboard  and  within  boat,  and 

• struck  by  boat  or  propeller. 

Although  separate  data  base  models  may  be  developed  in  each  of  these  areas,  they  should  be 
developed  so  as  to  be  compatible,  so  that  they  can  be  Integrated  into  a single  data  base 
covering  all  major  aspects  of  boot  accident  and  victim  recovery.  The  requirements  for 
compatibility  and  completeness  include  at  least  the  following: 

0 coding  all  basic  sample  data  including  boat  type,  length,  horsepower,  etc. 

• using  standardized  coding  in  all  work  so  that,  for  instance,  the  same  code 
is  used  for  houseboats  in  all  models 

• using  the  some  sample  for  coding  recovery  as  is  used  for  coding  accident 
cause,  and 
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• developing  comput'er  softwore  (programs)  with  sufficient  generality  so  as  to 

be  applicable  to  all  areas;  or,  as  an  intermediate  requirement,  thoroughly 
documenting  individual  programs  so  a program  can  be  eventually  developed 
which  includes  all  features  of  the  Individual  programs. 

The  advantage  of  having  a unified  data  base  is  that  information  ocross  accident  types  con  be 
generated.  For  instance,  a special  model  could  be  constructed  covering  all  areas  of  accident 
cause  and  victim  recovery  in  outboard  boats.  If,  say,  a powering  regulation  for  outboards  is 
contemploted,  one  would  be  able  to  exomine  all  accident  causes  which  might  be  related 
to  powering. 

Once  model  integration  has  been  accomplished,  there  should  be  an  effort  to  extend  its 
usefulness  in  pre-regulation  benefit  prediction  and  post-regulation  benefit  assessment  (tracking) 
Implementation  of  methods  in  these  areas  require  the  development  of  a supplementary  data  base 
as  well  as  additional,  supplementary  programs.  Descriptions  of  these  are  deferred  to 
Sections  3.0  and  4.0. 


13 


I 


3.0  BENEFIT  PREDICTION 
3.1  Infroductlon 

There  should  be  some  indication  that  the  promulgation  of  a contemplated  regulation  will  result 
in  the  saving  of  lives,  a reduction  in  injuries  and/or  a reduction  in  property  damage.  This 
section  describes  some  techniques  useful  in  predicting  such  benefits.  It  also  includes  a dis- 
cussion of  some  of  the  problems  involved  in  attempting  such  prediction.  One  certainty  has 
emerged  during  research  into  benefit  prediction  and  assessment  techniques:  unforeseen 
difficulties  can  appear  in  the  most  unexpected  places  when  carefully  analyzing  an  actual 
problem.  Although  these  difficulties  sometimes  seem  to  occur  almost  by  chance,  they  never- 
theless result  in  a fuller  understanding  of  the  processes  involved.  For  this  reason,  it  Is 
imperative  that  research  In  the  areas  of  benefit  prediction  and  assessment  techniques  not  be 
performed  in  a vacuum,  but  rather  that  such  research  involve  continuing  application  to  real 
data,  both  to  help  validate  the  techniques  developed  and  to  broaden  understanding  of  the 
complexities  involved.  When  real  data  is  not  currently  available,  carefully  developed 
synthetic  data  should  be  used  to  test  the  techniques. 

Early  in  the  research  into  regulatory  effectiveness  methodology,  it  was  decided  that  benefit 
prediction  could  usually  be  separated  into  the  following  three  phases: 

estimation  of  the  effect  that  a regulation  will  hove  on  the  specific  accident 
or  recovery  causative  factor(s)  it  is  designed  to  influence,  as  well  as  its 
effect,  positive  or  negative,  on  other  factors, 

estimation  of  the  benefit  which  would  accrue  if  the  full  effect  on  the 
influenced  factor(s)  were  available  immediately,  and 
projection  of  the  future  benefit  accruing  from  the  regulation  toking  into 
account  its  implementation  rate  and  projected  boating  trends. 

The  first  phase  would  appear  to  require  a separate  study  for  each  regulation  or  set  of  regu- 
lations under  consideration.  For  example,  to  estimate  the  effect  of  an  education  program 
designed  to  increase  PFD  wear,  it  might  be  necessary  to  run  tests  using  the  educational 
material  to  determine  its  influence  on  boaters'  behavior.  Such  experimentation  along  with 
other  dato  such  as  that  from  ARM,  would  result  in  an  estimation  of  the  proportion  of  people 
who  would  be  influenced  to  wear  PFDs. 
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Once  the  effect  of  a regulation  on  the  involved  fc:tor(s)  has  been  estimated,  it  should  be 
possible  to  use  the  data  base  model  to  estimate  what  the  resultant  benefit  would  be  if  the  full 
effect  of  the  regulation  could  be  felt  immediately.  For  instance,  in  the  case  of  education  to 
increose  PFD  weor,  ARM  would  provide  an  estimate  of  the  number  of  lives  soved  were  it 
possible  to  immediately  increase  PFD  wear  by  the  amount  determined  in  the  first  phase. 

The  third  phase  of  benefit  prediction  involves  forecasting  what  the  future  benefit  will  be.  In 
effect,  this  involves  these  steps; 

• generating  a curve  which  predicts  the  change  in  the  affected  factor(s)  over 
time, 

• forecasting  what  changes  in  boating  accident  patterns  would  occur  were  the 
regulation  not  promulgated,  and 

• combining  the  foregoing  with  the  benefit  figure(s)  derived  in  phase  two. 

In  the  following  poges,  each  of  these  three  phases  of  benefit  prediction  is  discussed  in  more 
detoil . 


3.2  Esti motion  of  the  Effect  of  g Regulation 
on  Accident  or  Recovery  Causative  Foctors 

Evidence  of  the  possible  need  for  a regulation  is  usually  first  discovered  by  the  Coast  Guard. 
Sources  of  evidence  include  analyses  of  dato  obtained  from  accident  reports  compiled  by  the 
Coost  Guard  from  its  own  investigations  and  from  investigations  performed  by  state  and  local 
authorities.  Other  sources  include  the  American  Boat  and  Yacht  Council  (ABYC),  other  boater 
and  consumer  organizations,  and  the  boating  industry,  including  manufacturer  defect  reports. 

Once  the  Coast  Guard  Office  of  Boating  Sofety  has  identified  the  possibility  of  o safety 
problem,  it  requests  the  Coost  Guord  Office  of  Research  and  Development  to  further  investigate 
the  situation.  The  first  step  is  a cause  identification  phase.  Statistical  analyses  of  data  base 
models  such  as  described  in  Section  2.0  may  be  quite  useful  in  both  this  stage  and  in  the 
originol  problem  identification  stage.  At  least,  such  analyses  should  help  narrow  the  area  of 
Investigation.  However,  research  methods  tailored  to  the  particular  problem  will  also  be 
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performed.  These  will  likely  include  further  analysis  af  accident  reports,  in-depth  accident 
investigations,  and  possibly  surveys  and  experiments  involving  boaters  and/or  boater  equipment 
designs . 

The  research  results  in  the  development  of  alternative  safety  enhancement  program  concepts. 
These  program  concepts  are  studied  by  the  Office  of  Boating  Safety  which  determines  thase  for 
which  advanced  develapment  research  is  desirable.  Advanced  development  involves  further 
research  into  the  precise  form  of  a program  and  inta  its  expected  benefits  and  costs.  It  is  in 
this  phase  and  the  previous  cause  identification  phase  that  estimates  are  made  of  the  effect 
that  a regulation  or  program  will  have  an  accident  or  recovery  causative  facators . 

These  estimates  will  be  made  by  using  expert  judgment  in  conjunction  with  statistical  data 
analyses,  equipment  performance  tests,  equipment  design  investigations,  experiments,  surveys, 
and  pratotype  programs.  For  example,  the  effects  that  a possible  modification  of  PFD  approval 
standards  would  have  on  PFD  wear  could  be  estimated  through  analyses  of  studies  of  current 
PFD  wear  and  the  attitudes  of  boaters  to  probable  new  PFD  designs.  The  estimated  effects 
(e.g.,  a 20P''-  wear  rate  increase)  can  then  be  used  in  making  benefit  estimates  as  described 
in  the  following  sections. 

3.3  "Full  Effect"  Benefit  Estimation 

In  Section  3.2  we  discussed  the  first  phase  of  benefit  prediction,  concerning  the  determination 
of  what  effects  o contemplated  regulatian  would  have  on  accident  ar  recovery  causative  factors. 
In  this  section  we  discuss  the  problem  of  converting  these  effects  (e.g.,  increased  PFD  wear) 
into  initial  benefit  estimates. 

At  first  glance  this  might  seem  to  be  a straight-forward,  relatively  simple  process.  Using  the 
* new  factor  estimates,  scy  increase  in  PFD  wear,  one  uses  the  data  base  model  to  calculate  the 

change  in  accident  frequencies  or  victim  fatalities.  Regrettably,  the  process  is  not  so  simple. 
Both  mathematical  problems  and  problems  with  insufficient  data  exist.  Initial  research 


indicated  that  these  prablems  were  sufficiently  complex  to  deserve  a significant  portion  of  the 
task  effort.  Because  of  the  complexities  involved,  a semi -chronological  appraach  will  be 
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token  in  discussing  the  reseorch,  so  that  the  reoder  will  hove  on  opportunity  to  see  how 
problems  and  complexities  developed.  Furthermore,  in  order  to  illustrate  the  methods  and 
problems  with  reasonably  simple  examples,  synthetic  (simulated)  dota  will  often  be  used. 
Although  the  methods  presented  were  developed  in  conjunction  with,  and  have  been  applied 
to,  real  data  (see  Reference  I)  the  use  of  real  dota  in  examples  would  often  unnecessarily 
complicate  them  and/or  obscure  the  principles  being  discussed. 

3.3.1  Benefit  Estimation  Based  Only  on  Reported  Victims 

In  its  most  simplistic  form,  the  calculation  of  benefits  involves  merely  the  mathematical 
transfer  of  a certain  number  of  reported  accidents  or  victims  * from  a "less  desi ruble"  state 
to  a "more  desirable"  state.  In  the  case  of  accident  recovery,  the  Accident  Recovery  Model 
includes  data  on  estimated  annual  numbers  of  reported  victims  and  survivors  who  are  in 
different  states;  that  is,  who  hove  different  survival  factors  associated  with  them.  To  describe 
the  method,  it  is  helpful  to  symbolize  the  quantities  included.  Let  Sp  be  o "less  desirable" 
state,  for  exomple  non-use  of  a PFD  by  a victim  in  the  water.  Let  S i be  a "more  desirable" 
state,  for  example  use  of  a PFD  by  a victim  in  the  water.  Suppose  these  states  are  disjoint; 
that  is,  no  victim  con  be  in  both  of  them.  Finally,  let  po  and  p j be  the  probabilities  of 
survival  of  victims  in  stotes  So  ond  S)  , respectively.  These  probabilities  may  be  calcu- 
loted  os: 


a , _ c 

Po  ~ ■g  P t “ g /■ 


where  a ond  c are  the  overage  annual  number  of  reported  accident  survivors  in  states  So  and 
S 1 , and  b and  d are  the  total  overage  onnual  number  of  reported  victims  in  states  So  and  S i , 
respectively.  Note  that  a < b and  c < d. 


* A victim  is  defined  as  any  person  involved  in  an  accident,  whether  or  not  the  person  survives. 
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It  is  helpful  to  diagram  those  quantities  as  follows: 


So 

Si 

a 

c 

^ = Po 

d = P’ . 

To  say  Sg  is  less  desirable  than  S ) means  po  < Pi  • Thus,  for  example,  a regulation  designed 
to  increase  PFD  use,  that  is,  to  cause  more  victims  to  be  in  state  S ] and  fewer  to  be  in 
state  Sg  , should  result  in  more  victims  surviving.  The  most  simplistic  approach  to  benefit 
calculation  involves  mathematically  "transferring"  victims  from  state  Sg  to  state  S j . 

Suppose  research  of  the  type  described  in  Section  3.2  indicates  that  a fraction,  r,  of  victims 
in  state  Sg  can  be  transferred  to  S j . For  example,  perhaps  an  educational  program  could 
result  in  30%  (r  = 0.30)  of  the  population  who  would  not  otherwise  use  PFDs  in  an  accident 
situation  to  use  PFDs,  The  transferred  victims  would  have  a higher  probability  of  recovery, 
p]  , than  they  otherwise  would  have.  The  benefit  resulting  from  the  regulation,  once  it 
became  effective  at  the  predicted  level,  could  then  be  calculated.  The  benefit  Bg  in 
average  number  of  lives  saved  yearly  can  be  calculated  from: 

• Bg  = rb  (p , - pg  ) . (3-2) 

This  formula  is  based  on  the  assumptions: 

• All  victims  in  state  Sg  hove  on  equal  probability  of  being  transferred  to 
state  S 1 . 

• The  recovery  probability  of  a victim  is  determined  solely  by  the  state  he  is  in. 
The  derivation  of  this  formula  may  be  found  in  Appendix  A, 

As  an  example,  suppose  the  average  annual  number  of  reported  victims  in  the  water  wearing 
PFDs  is  2313  and  of  these  victims  2267  survive,  yielding  98%  probability  of  recovery,  while 
4136  victims  in  the  water  do  not  use  PFDs  and  of  these  3598  survive,  making  their  probability 
of  recovery  87%.  This  may  be  diagramed  as: 
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If  research  of  the  type  described  in  Section  3.1  indicates  that  a contemplated  regulation  would 
eventually  result  in  PFD  wear  for  30°-'''  of  the  victims  who  otherwise  would  not  wear  them,  then 
the  eventual  benefit  could  be  colculated  os: 


Bo  = C.  30  (4136)  (0.98  - 0.87)  = 1 36  additional  lives  saved  per  year. 

Note  that  we  assume  there  is  no  change  in  Occident  or  victim  recovery  patterns  except  for  the 
transfer  effect  of  the  regulation. 

This  method  can  also  be  used  to  predict  the  number  of  lives  saved  as  the  result  of  a standard 
designed  to  reduce  the  number  of  Occidents  by  reducing  the  occurrence  of  a causative  factor. 
Suppose  thot  151  collisions  involving  1252  victims  of  whom  nine  die  occur  mainly  as  the  result 
of  steering  malfunctions.  If  it  is  estimated  that  a new  stondord  will  halve  the  number  of 
steering  malfunctions,  then  the  benefit  in  lives  saved  once  the  standard  became  fully  effective 
would  be: 


Bo  = C.5  (1252)  (1.00  - 0.9928) 
= 4.5 


1252-9 


where  1 .00  is  the  probability  of  survival  when  there  is  no  accident  and  - ~ 0.9928  is 

the  survival  probobility  of  a collision  victim  in  an  accident  involving  o steering  molfunction. 
Of  course,  this  result  could  be  obtained  more  simply  os  Bq  = j ~ 

3.3.2  Benefit  Estimotion  Toking  Into  Account  Unreported  Victims 


A problem  with  the  above  method  of  benefit  prediction  almost  immediately  presented  itself. 
The  Caast  Guard  has  no  record  of  most  non-fatal  accidents  and  accident  victims  because  most 
such  accidents  are  never  reported.  Thus,  there  are  many  accidents  and  victims  not  accounted 
for  in  the  statistics  or  the  doto  base  models,  and  the  survival  probabilities  are  higher  than 
indicated  because  these  victims  are  survivors.  (Virtually  all  fatalities  are  reported.) 
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Two  means  of  dealing  wi^h  fhis  problem  were  considered.  The  roi’al  number  of  vicHms, 
reported  and  unreported,  in  each  state  could  be  estimated  and  these  numbers  could  be  used 
to  calculate  survival  probabilities  and  benefits.  The  other  means  considered  involved 
developing  error  bounds  on  the  calculated  benefit.  It  was  felt  that  this  later  approach  would 
be  more  useful  and  would  require  less  data  estimation  or  the  need  for  additional  data  collection 
through  surveys,  etc. 

In  order  to  develop  error  bounds  on  the  calculated  benefit  Bg  , it  was  first  necessary  to  express 
the  actual  benefit  B as  a function  of  additional  variables,  defined  as  follows; 

• Let  X be  the  total  average  annual  number  of  unreported  accident  victims  in 
states  Sg  and  5i  , with  a and  yS  the  fractions  of  these  victims  in  state  Sg 
and  in  state  S j , respectively. 

• As  an  immediate  consequence  of  this  definition  we  have  that  ax  is  the 

number  of  unreported  vi cti ms  in  state  S g , ySx  is  the  number  of  unreported 
victims  in  state  S 1 and  a + 0 =1. 

In  order  to  make  use  of  these  variables,  we  make  the  assumption: 


• All  unreported  accident  victims  are  survivors. 

This  assumption  is  consistent  with  current  estimates  of  the  reporting  rates  for  fatalities  which 
indicate  that  virtually  all  fatalities  are  reported.  With  this  assumption,  the  total  numbers  of 
victims  (reported  and  unreported)  in  states  Sg  and  S i can  be  expressed  as  b ce  x and  d ySx, 
resoectively , while  the  corresponding  numbers  of  survivors  are  given  by  a + a x and  c -r  /Sx. 


Using  these  quantities  to  express  the  survival  probabilities  pg  and  p'l  for  all  victims  in 
states  Sg  and  S i , we  have: 


a + ax  , , c + ax 

1— ; and  p'l  = — 

b - ax  d + px 


This  may  be  diagramed  as: 

Sg  S, 
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The  full  effect  benefit  B expressed  as  the  overage  annual  number  of  lives  soved  is  given  by: 

• B = B(x  , a ) = r(b  + a x)  (p'l  - p'o  ) (3 

where,  as  before,  r is  the  fraction  of  victims  "transferred"  by  the  regulation  from  stote  So 
to  stote  S 1 . 


3.  3.2.1  Testing  for  Positive  and  Minimum  Benefits  — One  is  interested,  of  course, 
in  regulations  which  will  cause  boats  or  accident  victims  to  be  in  more  desirable  states.  That 
is,  one  desires  positive  benefits  (lives  saved).  Mathematically,  this  means  thot  p'o  < p'l  , 
since  we  ore  considering  So  as  the  state  transferred  from  and  S i as  the  state  transferred  to. 
Thus,  we  hove  as  a condition  for  positive  benefits: 


P'o  < p'l  * 


or  equivalently. 


• (a  + a x)  (d  + x)  < (b  + a x)  (c  + x)  , - 1 - a (3 

Formulas  3-3  and  3-4  can  be  used  to  calculate  benefits  directly  if  the  quantities  x and  a 
can  be  estimated.  If  only  range  estimates  of  0(  or  x can  be  made,  then  the  error  bounds 
discussed  loter  can  be  used. 


* Since  the  actual  requirement  for  positive  benefits  is  p'o  < p'\  , it  is  theoretically  possible 
to  have  p'o  < p'l  while  concurrently  having  po  > pi  • However,  this  circumstance  is  highly 
unlikely  and,  in  view  of  the  dearth  of  data  on  unreported  accidents  and  victims,  the 
consideration  of  a regulation  affecting  conditions  in  which  p'o  < p't  but  po  > pi  is 
even  more  unlikely.  Clearly,  any  such  regulation  would  require  the  most  careful  study. 
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Before  any  significanf  amounf  of  work  Is  performed  fo  attain  estimates  of  Cl  or  x , however, 
some  aftempf  should  be  made  to  determine  If  Inequalities  3-5  are  satisfied.  Checking  the 
inequality  pg  < pi  (or  equivalently,  ad  < be)  is  easy  provided  the  data  base  model  contains 
the  appropriate  data.  To  check  the  inequality  pg  < p'l  at  least  rough  variable  estimates 
are  needed.  Table  1 contains  alternate  forms  of  inequalities  3-5  and  3-6  which  may  be 
easier  to  check.  Note  that  as  the  two  inequalities  under  condition  A in  the  table  are 
equivalent,  if  one  is  true  then  both  are  true,  and  if  one  is  false  then  both  are  false, 
so  it  is  only  necessary  to  check  one  of  them. 

As  the  inequalities  under  condition  A do  not  involve  the  variable  x,  it  should  be  a relatively 
straightforward  process  to  determine  if  this  condition  is  met.  Conditions  B and  C are  somewhat 
more  difficult  to  check  as  the  variable  x is  also  present. 

To  ease  the  problem  of  having  to  estimate  both  x and  Cl  , two  methods  ore  suggested.  The 
first  involves  estimating  one  of  these  variables  and  using  the  estimate  in  computing  the  right 
side  of  inequality  3-9,  3-10  or  3-11 , whichever  is  appropriate.  The  value  obtained  will  be 
an  upper  or  lower  bound  on  the  value  of  the  remaining  variable,  if  positive  benefits  are  to 
result.  One  then  must  only  decide  if  the  remaining  variable  has  a value  below  or  above  this 
bound,  and,  thus,  if  the  inequality  is  satisfied  and  condition  B or  C is  met.  The  same 
procedure  can  be  used  in  testing  condition  A by  rewriting  inequality  3-8  as: 

a < (3-i: 

c«<b+d-a-c' 


The  second  method  involves  graphically  testing  inequality  3-11  by  graphing  the  curve: 


(b  - a)  + (d  - c) 
(where  a + $ =1) 


( (be  - ad)  ^ + (b  - a)  j , 


with  a as  the  ordinate  variable  and  x as  the  abscissa  variable.  One  can  then  examine  the 
graph  to  determine  if  any  reasonable  combination  of  x and  a would  fall  above  the  curve 
implying  inequality  3-11  might  be  false  and,  thus,  that  the  regulation  might  result  in  negative 
benefits , 
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As  an  illustration,  let  us  return  to  the  earlier  example  on  PFD  wear.  Recall  that  Sq  was 
taken  as  the  state  of  non-PFD  wear  and  S j as  the  state  of  PFD  wear.  Representing  the 
quantities  schematically,  we  have: 

So  S, 


o 


3598 

4136 


= 0.87  = po 


c 

d 


2267 

2313 


= 0.98  = Pi 


Note  that  the  inequality  Po  < Pi  is  satisfied. 

The  first  step  required  in  order  to  take  into  account  unreported  accident  victims  (all  assumed 
to  be  survivors)  is  to  check  that  transferring  both  reported  and  unreported  victims  from  So  fo 
$1  will  produce  positive  benefits;  that  is,  to  check  that  p'o  < p'l  . To  do  this,  we  first  check 
condition  A.  Suppose  a rough  estimate  of  the  froction  of  unreported  victims  who  wear  PFDs 
is  ^ = 0.15.  Then  Cf  = 0.85,  and  we  can  test  inequality  (3-7): 


d - c 
b - a 


2313  - 2267 
0.15 

4136  - 3598 
0.85 


= 306.7 


= 632.9 


We  find  that  inequality  3-7  Is  satisfied  and,  thus,  condition  A is  met,  meaning  that  p'o  < p'l  . 

For  a second  illustration,  suppose  that  instead  of  the  estimate  of  a as  0.85,  we  estimate  that 

oe  = 0.95.  Testing  condition  A with  this  value,  we  might  use  inequality  3-8: 

(a)(b+d-a-c)  = (0.95)  (4136  + 2313  - 3598  - 2267)  = 554.8 

b - a = 4136  - 3598  = 538  . 

Inequality  3-8  is  not  satisfied,  so  condition  A is  not  met  and  we  must  proceed  to  check  either 
condition  Bor  condition  C.  Let  us  check  condition  B.  Suppose  we  are  unsure  as  to  what  value 
we  should  take  for  x . We  can  first  calculate  the  value  of  the  right  side  of  inequality  3-10, 
noting  that  yS  = 1-ci  = 0.05: 

be  - ad  (4136)  (2267)  - (3598)  (2313)  _ 

(d  - c)  a - (b  - a\0  " (23l3  - 2267r(0.95)  - (4)36  - 3598)  (0.05) 


I • 
» * 
I . « 
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A decision  must  now  be  mode:  Is  inequality  3-10  true?  That  is,  is  x less  than  or  greater 
than  62,746?  If  x < 62,746,  then  p'p  < p'^  and  positive  benefits  (lives  soved^  will  result 
from  o regulotion  resulting  in  increosed  PFD  wear.  If  x > 62,746,  then  p'p  > p'^  and  no 
benefit  or  a negotive  benefit  (lives  lost''  would  result  from  such  a regulation. 

Should  it  be  determined  that  p'o  > p'l  then  any  regulation  hoving  as  its  only  effect  the  transfer 
of  victims  from  state  Sq  to  S j should  be  counterproductive  * . If  it  Is  found  that  pj  < p'l  , 
then  such  a regulation  might  be  beneficial  and  furti.ur  study  is  warranted.  Even  if  it  is 
determined  thot  d'q  < p'l  , it  may  be  that  the  benefit  derivable  from  o regulation  is  too  small 
to  justify  the  regulation's  promulgation.  Certainly,  it  is  preferable  to  obtain  a rough  estimate 
of  what  the  benefit  may  be  before  expending  a large  sum  in  further  research.  The  benefit  may 
be  calculated  from: 

o B = r(b  - a x)  (p‘,  - p'o  ) , 

or  the  equivolent  formulo; 


B = ( be  - ad  [(b  - a)  - (d  - c)  a ] x ) 


(3-14) 


Of  course,  the  same  problem  of  esti mati ng  x and  a remains.  (Recall  that  = 1 - a , so 

on  estimate  of  Or  yields  on  estimate  of  .)  Again,  it  is  possible  to  ease  this  estimation 

problem.  One  means  of  doing  so  is  to  estimate  one  of  the  variables,  or  or  x , and  decide  on 

the  minimum  benefit  B occeptoble.  These  values  con  then  be  substituted  into  the  appropriate 

m 

inequolity  in  Table  2 ond  o determination  con  be  made  as  to  whether  the  remaining  variable 

is  likely  to  hove  o value  which  will  satisfy  that  inequality  so  that  at  least  the  minimum  benefit 

B can  be  attained, 
m 

As  an  example,  consider  a construction  standard  which  would  require  the  addition  of  hand-holds 
to  boats  so  that  a victim  in  the  water  holding  onto  a boot  would  be  less  likely  to  lose  his  grip. 
Suppose  there  is  on  annual  average  of  2021  Occident  victims  who  enter  the  water  but  hold  onto 
their  boats,  1714  of  whom  monage  to  remain  with  their  boats  and  307  of  whom  lose  their  grip. 


However,  there  ore  intricacies  we  have  not  yet  discussed.  Be  certain  to  read  Section  3.3.3. 


mm 


TABLE  2.  DETERMINING  IF  A MINIMUM  BENEFIT  CAN  BE  ACHIEVED 


To  test  for  a minimum  benefit  B^,  use  either  of  the  quantities  W or  Z in  the  appropriate 
inequality.  If  this  inequality  is  satisfied,  the  minimum  benefit  is  (theoretically)  achievable, 
othervi^ise  it  is  not. 


Given  an  estimated  a value,  calculate: 


W = ;?B  +r  f(d-  c)ce  - (b  - a)  ) 

m ' ' 


If  W>  0,  check  the  inequality 


If  W<  0,  check  the  inequality 


> W ■ “m''] 


If  W=  0,  check  the  inequality 
B <4  ~ 

m — d 


Suppose  further  that  the  survival  probability  of  victims  who  do  not  lose  their  grip  is  0,98, 
while  the  survival  probability  of  those  who  lose  their  grip  is  only  0.43.  Colculating  the 
number  of  survivors  in  each  case  and  presenting  the  quantities  schematically,  we  have: 


So  S, 


We  estimate  that  80®A  of  the  unreported  victims  are  in  states  Si  , i.e.,  ;3  = 0.80.  Hence, 

Ct  is  estimated  to  be  0.20.  It  is  estimated  that  r = 0.30,  that  is,  that  hand-holds  would  enable 

30®^  of  those  victims  who  currently  lose  their  grip  to  retain  it.  A minimum  benefit  B of  ten 

m 

lives  soved  is  desired. 

Using  equation  3-15  in  Table  2,  we  calculate: 

W = (0.80)  (10)  + 0.30  ((1714  - 1680)  (0.20)  - (307  - 132)  (0.80)) 

= -32.0  . 


As  W < 0 we  check: 


X > [0.30  ((307)  (1680)  - (132)  (1714))  - 10  (1714)] 

X > -2179  . 


Obviously,  any  admissible  value  of  x satifies  this  inequality,  so  it  appears  that  the  standard 
would  meet  the  minimum  benefit  requirement  of  saving  at  least  ten  lives. 


An  olternotive  method  involves  constructing  o table  of  benefit  values  for  severol  a , x - 
combinations.  The  table  might  display  a values  along  the  top  row,  x values  down  the  left 
column  and  B values  in  the  body.  The  table  could  then  be  examined  to  see  if  reasonoble 
values  for  a and  x would  yield  acceptably  high  benefit  values. 
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A third  method  would  be  to  construct  level  curves*  for  selected  benefit  values  and  then,  os 
with  the  table,  determine  if  reasonable  values  for  oi  and  x would  yield  acceptably  high 
benefits.  Equation  3-14  or  either  of  the  following  equivalent  equations  could  be  used  to 
construct  the  curves; 

r(bc  - ad  + bx  - ax)  - B(d  x) 


- B 


- a ~ c)  Ct 


(1  - a)B  . 


As  an  example  of  this  method,  consider  the  hand-hold  example  just  presented.  Retaining  the 
same  data  on  known  victims  we  have,  as  before: 


- = = 0 43 

b 307 


c ^ 2^  = 0 98 
d 1714 


If  we  also  retain  our  estimate  of  r = 0.30,  then  equation  3-23  (or  3-24)  enables  us  to  construct 
level  curves  for  various  benefit  values.  Rgure  3-1  illustrates  several  such  curves.  Note  that 
admissible  a and  x volues  fall  in  the  ranges  0 < C*  < 1 , 0 x . Thus,  we  see  that  if  there  are, 
say,  at  least  1000  unreported  victims,  then  a benefit  of  about  50  lives  soved  is  not  unreasonable 
This  is  of  course  based  on  an  estimate  of  r = O.X.  Curves  could  be  similarly  drawn  using 
different  volues  of  r. 

In  general,  in  using  the  level  curve  method,  if  a judgment  is  reached  that  acceptably  high 
benefits  would  likely  result  from  the  contemplated  regulation,  a more  careful  analysis  can 
be  performed.  In  this  anolysis,  more  careful  estimates  of  a , x and  r could  be  made,  and 
benefits  could  then  be  calculated  using  equation  3-l4.  This  is  discussed  in  the  following  cages. 


* A level  curve  is  a groph  of  all  (a  , x)  points  which  yield  the  same  value  of  B.  That  is, 
for  eoch  fixed  value  of  B,  equation  3-23  (or  3-24)  gives  a different  level  curve. 
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3.  3.2.2  Error  Bounds  on  Benefit'  Estimates  — In  many  cases  it  may  not  be  possible  to 
estimate  a single  value  for  x or  for  ct  or  for  either  of  these  variables.  In  such  a case,  by 
estimating  a range  of  values  that  the  variables  might  take  it  is  possible  to  obtain  error  bounds 
on  the  expected  benefit  B;  that  is,  to  obtain  a corresponding  range  of  benefit  values.  In 
Instances  where  estimates  cannot  be  made  with  any  degree  of  confidence,  limiting  processes 
can  be  used  to  arrive  at  error  bounds. 


Let  us  recall  equation  3-14  which  expresses  the  expected  benefit  of  a regulation  (in  average 
annual  lives  saved)  as  a function  of  x and  a : 

B = B(a,  x)  = , ■/—-  (be  - ad  + [(b  - a)j3-  (d  - c)of]  x)  (3-14) 

d X 

where  /?  = 1 - oc  . 

This  formula  may  be  used  to  calculate  benefit  values  for  any  values  of  x and  a , 0<  x, 

0<  a < 1 . 

Table  3 contains  all  of  the  inequalities  and  other  information,  including  limiting  values, 
which  should  be  needed  in  the  calculation  of  error  bounds.  We  present  some  examples. 

In  a prior  example  involving  PFD  wear,  the  following  data  was  used. 

Reported  Victims,  Pre-Regulation 
$0  (non-weor)  S j (wear) 

Using  an  estimoted  value  of  Ct  = 0.85,  it  was  found  that  p'o  < p'l  so  positive  benefits  would 

result  from  tronsferring  victims  from  Sq  to  S j , that  is,  from  increasing  PFD  wear.  Suppose  !' 

it  is  estimated  that  a contemplated  regulation  would  achieve  an  r value  of  0.20;  that  is,  ,! 

20%  of  the  PFD  non-wecrers  could  be  made  into  PFD  wearers.  To  calculate  the  anticipated  i,; 

benefit  B from  such  a regulation,  it  is  necessary  to  know  the  number  x of  unreported  accident 

victims  in  these  states.  Suppose,  however,  that  we  are  unable  to  estimate  this  number.  We 

i 

can  use  Table  3 to  obtain  error  bounds  on  B. 
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As  no  esHmote  for  x is  given,  we  use  fhe  values  x i - 0,  X2  = as  given  in  part  B.2.  of  fhe 
table.  Comparing  a with  ^ ^ we  have: 


+ d “ 4)36  ^2313 


= 0.64  < 0.85  = a 


So  port  A.2.b.  of  the  table  applies  and  we  hove: 


8(0.85,  00)  < B(a,x)<  B(0.85,0) 


Using  part  B.2.b.  of  the  table  for  B(0.85,oo)  we  have: 

B(o.85,«)  = [(4136  - 3598)  (0.15)  - (2313  - 2267)  (0.85)]  =55 

Also,  using'port  B.2.o.  of  the  table, 

B(0.85,0)  = (0.20)  (4136)  (0.98  - 0.87)  = 91  . 


Thus,  we  obtain  as  error  bounds: 

55  < B<  91  . 

So  we  con  expect  to  sove  between  55  and  91  lives  annually  by  promulgating  the  contemplated 
regulotion. 

As  0 second  example,  let  us  use  the  some  data  as  in  the  first  example,  but  reploce  our 
estimate  of  a = 0.85  with  a lower  bound  Of  j for  a , soy  a \ = 0.60.  Note  that  0.60 
sotisfies  condition  A in  Table  1 for  positive  benefits,  but  it  is  possible  that  some  values  of 
Of  > 0.60  might  yield  negative  benefits.  We  use  Toble  3 to  determine  what  the  benefit 

range  is. 

As  we  have  no  upper  bound  Of  2 for  Of  we  take  0 2=1*  Now  ^ j = 0.64,  so 

Q < _^ <02  and  part  A. 3. c.  of  Table  3 applies.  Note  that  in  this  case  only  an 

upper  bound  x 2 for  x is  needed,  and  as  we  have  no  estimate  of  X2  we  use  X2  = » . 


31 


Let  0<Cii  <a<ot2£l/0<xi<x<X2'  Then, 

A.  These  basic  inequalities  may  be  used. 

1.  B(a2/  x)  < B(a,  x)  < B(ai,  x)  (3-25) 

2(a).  If  a < I , then  B(ct  , x])  < B(a  , x)  < B(ot,  X2)  (3-26) 

2(b).  If  ot  > I ^--1  , then  B(a  , X2)  < B(a  , x)  < B(ct,  xj)  (3-27) 

3(a).  If  tt2  < I ^ , then  B(oe  2,  x l)  < B(oe,  x)  < B(ai,  X2)  (3-28) 

— b T d — — 

3(b).  If  < c*  1 / I’hen  B(a  i,  xz)  < B(a , x)  < B(  a 1,  x 1)  (3-29) 

L 

3(c).  If  a 1 < < ct  2r  B(ct  2r  X2)  < B(a , x)  < B(a  i,  X2)  . (3-30) 


Note  that  the  value  xi  Is  not  used  ct  all  in  3(c);  all  that  is  needed  is  an  upper  bound  X2  on  x. 

B.  If  one  or  more  bounds  on  a or  x cannot  be  obtained,  use  the  following  in  the 
appropriate  inequality  above. 

1(a).  a , = 0 

1(b).  ^2  = 1 

2(a).  X I = 0.  B(a  , 0)  = Bq  = rb(p ) - po  ) = •g  (be  - adl  (3-31) 

2(b),  X2  = « . B(a,oo)  = lim  B(a,  X2) 

Xj-00 

= 3 [(b-a)/?  -(d-c)a],a<  1 (3-32) 

P 

B(l,oc)  = -30,ifc  < d 


= r(b  - a),  if  c = d . 


(3-33) 


TABLE  3.  BENEFIT  ERROR  BOUNDS  RESULTING  FROM  UNREPORTED  VICTIMS  (concluded) 


C.  Irrespective  of  the  error  bounds  derived  above,  the  following  olways  will  hold. 

1 . If  p'o  < p'l  for  all  {a  , x)  values  under  consideration,  then  0 < B (a  , x)  (3-34) 


2.  B(a  , x)  < r(b  - o) 


(3-35) 


Suppose  the  x unreported  victims  ore  distributed  between  states  Sq  ond  S j in  the  some 
ratio  as  the  reported  survivors. 


If  PO  < Pi  , then  Bo  < B < — Bq 

- _ _ p , 


(3-36) 


if  Po  > Pi  , — Bo  < B < Bo  , 

- P 1 - - 


(3-37) 


where  Bo  = rb(pi  - po  ) = -g  (be  - ad)  is  the  benefit  ond  po  “ ^ ' Pi  ~ § 
are  the  state  So  and  Si  survival  probabilities,  all  calculated  by  taking  only  reported 


victims  into  occount. 


Thus  we  have; 


r 


► 


B(1,oo)  < B(a,x)  < B(0.60,oo)  . 
Now  using  part  B.2.  of  the  table,  as  c < d. 


B(1,oo)  = -00  . 


Also,  B(0,60,oo)  = [(4136  - 3598)  (0.40)  - (2313  - 2267)  (0.60)]  = 94  . 

Thus,  -oo  < B < 94  . 

Obviously,  these  error  bounds  ore  too  large.  In  order  to  obtain  tighter  bounds,  we  may  resort 
to  Table  1.  From  condition  B of  Table  1,  we  see  that  in  order  to  have  positive  benefits  when 
a - 1 , we  must  have: 


(4136)  (2267)  - (3598)  (2313) 
2313  - 2267 


22,916  . 


Unless  we  hove  good  reason  to  believe  that  there  are  fewer  than  22,916  unreported  victims 
or  we  can  place  a more  realistic  upper  bound  on  a , we  must  conclude  that  the  contemplated 
regulation  might  result  in  a negative  benefit  — lives  lost  instead  of  saved. 

As  a final  exomple,  let  us  use  the  same  numbers  for  reported  victims  and  agoin  take  r = 0.20, 
but  let  us  assume  that  the  unreported  victims  act  like  the  known  survivors;  that  is,  that  the 
unreported  victims  are  distributed  between  Sg  and  Sj  in  the  same  ratio  as  the  known  survivors. 
Then,  from  port  D of  Table  3, 

Bg  < B < — Bg  . 

- - P 1 

Now,  Bg  = rb(p,-pg)  = (0.20)  (4136)  (0.98  - 0.87)  = 91 
^ = (^)  <”) ' ’3 . 

Thus,  we  estimate  that  the  contemplated  regulation  could  result  In  saving  from  91  to  93  lives 
per  year,  provided  unreported  victims  act  like  known  survivors. 


l| 


1' 

i 


34 


As  a postscript  to  this  section  we  give  a brief  description  of  the  chronology  of  the  development 
of  the  techniques  for  dealing  with  the  problem  of  unreported  accidents.  It  has  been  well  known 
to  researchers  in  the  area  of  recreational  boating  safety  that  while  virtually  all  boating 
accidents  involving  fatolities  ore  reported  to  the  Gsast  Guard,  most  other  boating  accidents 
are  not  reported.  Furthermore,  much  more  detailed  reports  are  made  on  fatal  accidents  than 
on  non-fotol  accidents.  Thus,  while  the  Coast  Guard  has  some  data  on  accident  causes  and 
recovery  circumstances  in  fatal  Occidents  it  hos  much  less  of  this  dato  for  non-fatal  Occidents. 

It  wos  reolized  that  by  considering  only  data  from,  reported  accidents  in  analyses  of  accident 
cause  and  victim  recovery  that  distortions  in  results  might  occur.  In  particular,  it  was  clear 
that  in  many,  if  not  most,  cases  the  recovery  probabilities  of  accident  victims  in  particular 
circumstances  would  be  underestimated  * . What  would  be  the  effect  of  such  underestimation? 

The  case  of  estimating  benefits  by  transferring  victims  from  a state  So  to  a state  S i was 
considered.  In  oddition  to  the  assumption  that  all  fatalities  ore  reported,  a second  assumption 
was  initially  made  — that  unreported  victims  hove  the  same  recovery  circumstances  as  reported 
survivors.  Under  these  assumptions,  it  was  discovered  that  in  most  coses  the  difference  p'l  - p'o 
in  recovery  probabilities  in  the  two  states  5 i and  So  would  be  less  than  that  calculated  by 
considering  only  data  for  reported  victims  * . It  thus  appeared  that  using  probabilities 
derived  only  from  data  for  reported  victims  would  result  in  overestimation  of  benefits. 

Further  anolysis,  however,  showed  that  the  opposite  was  true.  Under  these  assumptions,  for 

Po  < pi  the  inequality  (3-36)  Bq  < B < — Bq  was  true,  where  Bq  was  the  benefit 

P 1 

calculated  by  using  only  data  for  reported  victims.  So  benefits  would  octually  be  under- 
esti  mated . 

Later,  equations  such  as  3-14  and  inequalities  such  as  3-26  were  developed  giving  benefits 
and  error  bounds  under  assumptions  that  non-reported  victims  were  distributed  between  states 
in  ony  pre-selected  manner.  Finally,  methods,  such  as  those  involving  Tables  I and  2 were 
developed  to  help  in  determining  if  realistic  choices  for  the  variables  a and  x would  likely 
result  in  positive  benefits. 


The  derivation  of  this  result  may  be  found  in  Appendix  A. 


3.3.3  MulH-Sfate  Benefit  Analysis 


Up  to  this  point  we  have  only  discussed  benefit  estimation  problems  involving  transferring 
victims  from  a single  state  Sg  to  another  state  S ] . However,  as  the  example  below  illustrates, 
considering  transfer  between  only  two  states  is  too  restrictive  and  often  can  lead  to  erroneous 
results.  Although  the  data  in  the  example  is  synthetic,  it  will  illustrate  precisely  the  type  of 
problem  thot  occurred  when  the  Accident  Recovery  Model  fl?eference  I ) was  analyzed. 

The  use  of  synthetic  data  enables  us  to  present  a simple  example  which  clearly  demonstrates 
the  Important  principles  involved.  * 

Suppose  an  educational  program  to  increase  PFD  use  is  being  considered.  During  an  initial 
analysis  of  the  Accident  Recovery  Model  data  base  for  PFD  use,  a startling  discovery  is  made. 

The  calculated  recovery  probability  of  accident  victims  in  the  water  who  do  not  use  a PFD  is 
found  to  be  greater  than  the  calculated  recovery  probability  of  victims  in  the  water  who  do  use 
a PFD.  (This  is  the  sort  of  unexpected  difficulty  reffered  to  In  the  first  paragraph  of  Section  3.1  .) 
Can  it  really  be  that  PFD  use  is  detrimental  to  survival,  or  is  there  another  factor  at  work? 
Fortunately,  it  Is  the  later  explanation  which  applies.  Not  only  is  there  an  Interaction  between 
PFD  use  and  survival,  but  there  is  also  an  interaction  with  other  factors  affecting  both  PFD  use 
and  survival.  That  is,  survival  probabilities  and  PFD  use  probabilities  are  conditional  on  other 
factors,  so  that,  for  Instance,  two  victims  In  the  state  "PFD  Used"  need  not  have  the  same 
survuval  probability.  This  is  most  easily  seen  with  a numerical  example. 


Consider  the  following  table  of  (synthetic)  data  which  separates  PFD  use  and  non-use  into  two 
categories,  adults  and  children.  Each  entry  in  the  table  is  of  the  form: 


't 


survi  vors 
vi  cti  ms 


survival  probability  . 


* Reference  2 contains  a more  complex  example  using  real  data, 
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Note  that  PFD  use  is  advantageous  both  forodults  and  for  children;  in  both  cases  survival 
probabilities  are  greater  with  PFD  use  than  without  PFD  use.  However,  when  victims  are  not 
separated  by  age,  the  probability  of  survival  for  a victim  not  using  a PFD  is  calculated  as: 


980  ^200  _ 1180  _ 

1000  + 300  ' 1300 

while  the  survival  probability  for  o victim  using  a PFD  is  colculated  as: 

^ 99^  250  _ 349  ^ 

P’  100  + 300  ' 400  ■ 

The  survival  probability  for  PFD  non-use  is  greater  than  for  PFD  use  ! 

As  will  be  seen  later,  this  apparent  anomaly  is  due  to  the  distribution  of  PFD  use  among  adults 
and  children.  It  is  a result  of  the  fact  that  in  the  example  adults  have  a greater  survival 
probability  than  do  children,  but  adults  use  PFDs  much  less  frequently  than  do  children. 


In  this  example  and  in  the  general  discussion  which  follows  it  one  must  remain  cognizant  of 
the  cause  of  the  problem.  It  is  not  a result  of  sample  data  being  unrepresentative.  Rather, 
it  is  a result  of  the  octual  circumstances  in  which  accidents  occur.  The  survival  probability 
of  a victim  normally  depends  on  many  interrelated  factors,  and  thus  considering  survivol  as 
a function  of  only  a broad  cotegory,  such  as  PFD  wear,  is  actually  an  unrealistic  simplification 
of  more  complex  clrcumstonces . Such  unjustified  simplification  can  lead  to  erroneous  and  even 
ridiculous  results. 

Several  questions  arise:  What  is  the  relationship  between  the  overall  survival  probability  in 
a state  and  the  survival  probobllitles  in  sub-states  where  other  factors  are  taken  into  account? 
How  should  benefits  be  calculated?  When  must  other  factors  be  taken  into  account  and  when 
con  they  be  safety  ignored? 

While  research  into  all  aspects  of  the  problem  is  far  from  complete,  it  is  possible  to  give  at 
least  partial  answers  to  these  questions.  In  order  to  express  these  answers  in  a precise  manner, 
it  is  necessary  to  introduce  some  additional  notation. 
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Let' So  and  S ] be  two  mutually  exclusive  * states  and  let  T i,  T2  , Tn  be  a collection 
of  mutually  exclusive  states.  Let  Sq  Tj  , 1 < i < n,  denote  that  sub-state  of  Sq  and  Tj  which 
is  determined  by  the  defining  conditions  for  both  Sq  and  Tj  . That  is,  considering  Sq  and  Tj 
os  sets  of  victims,  Sq  T j is  the  set  intersection  Sq  ft  T j , so  that  a victi m is  in  state  S q T j 
if  and  only  if  he  is  in  both  state  Sq  and  in  state  T ; . Let  S 1 Tj  be  defined  similarly.  For 
instance,  if  Sq  and  S 1 denote  PFD  non-use  and  use,  respectively,  and  T ] and  T2  denote 
adults  and  children,  respectively,  then  Sq  T(  denotes  adults  not  using  PFDs,  $i  T2  denotes 
children  using  PFDs,  etc. 


Also,  for  each  i,  i<i<n,  leta.,b.  and  p, . denote  the  number  of  survivors,  number  of 
— - 11  Oi 

victims  and  survival  probability,  respectively,  in  state  Sq  T.,  and  let  c.,  d.  and  p^.  denote 

the  number  of  survivors,  victims  and  survival  probability,  respectively,  in  state  S i Tj  **  . Let 

a,  b and  Pq  denote  the  number  of  sur/ivors,  number  of  victims  and  survival  probability, 

respectively,  in  state  , and  let  c,  d and  p^  denote  the  number  of  survivors,  number  of 

victims  and  survival  probability  in  state  S ^ . Let  q^,  (or  q ^.)  denote  the  probability  that  a 

victim  in  state  S (or  5,  ) is  also  in  state  T.  , 

01  I 

These  definitions  immediately  lead  to  the  following  results: 


o 


o 


o 


o 


a = a + a + 
I 2 


n 

b = b,+b  + ...+b  = b . 

' 2 n I 

I = ) 


c = c,+c„  + ...+c 
1 2 n 


d = di+d,  + ...+d 
' 2 n 


(3-38) 


* By  this  we  mean  that  a victim  cannot  be  in  more  than  one  of  the  mutually  exclusive  states. 
Expressed  in  set-theoretic  nototion,  S(jDSi  = ;0ondTiDTj  = ^forixj,  0<i,j<n. 

**  Although  we  use  the  notations  po/  Pi,  etc.,  reserved  earlier  for  statistics  based  on  reported 
accidents  and  victims,  in  this  section  all  quantities  may  be  considered  as  referring  either  to 
statistics  based  on  reported  victims  or  to  statistics  based  on  all  victims;  the  results  derived  hold 
in  either  case . 
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(3- 


o Poi  = FT'  ’ 


o p,i  = dT'  ’ ^ ^ " 


, 1 < i < n 


— , 1 < i < n 
d — — 


o +...+q 

^01  ^02  ^On 


X,  ''Oi 

I = 1 


o q,,+q,^  + ...+q,^  = q,.  = 1 

I = 1 

Since  these  definitions  and  results  are  a lot  to  absorb  at  one  time,  it  will  help  to  relate  them 
to  the  above  example  involving  PFD  use  in  adults  and  children.  We  rewrite  and  expand  the 
table  in  that  example,  including  our  new  notation. 


(Adults) 

(Chi  Idren) 

Sp  (PFD  not  used) 

_ 980 
b,  1000 

= 0.98 
Pol 

°2  200 
F7  ~ 300 

= 0.67 
*^02 

S 1 (PFD  used) 

_ 99 
d,  ^ 100 

= 0.99 
' Pii 

^2  _ 250 

d “ 300 
2 

= 0.83 
" Pl2 

rnrnmmm 


Mosf  of  the  quantities  are  presented  in  fhe  table.  The  values  for  q o i , qii  are  not.  They  are: 


'*01  = 


02 


II 


^ 12 


1000 

1000 

1000  + 300 

1300 

300 

300 

1000  + 300 

1300 

100 

100  + 300 

II 

sis 

300 

100  + 300 

II 

m 

0.77 

0.23 

0.25 

0.75 


Now,  the  first  of  the  questions  we  posed  concerning  the  relationship  between  state  and 
sub-state  survival  probabilities  is  answered  by  the  following  result. 


and 


PO 


= g (bl  Poi  + b2  P02  ...  + bn  Pon  ) = g bi  po| 


- POlPOI  + P02P02  + ...  ^ POnPOn  = POiPoi 

i = F 


Pi 


= g (dip  II  +d2Pi2  + ...  +dnPin)  =g  Y2 

i = 1 

n 

= PllPlI  + PI29I2  ...  + PlnPln  = PliPli 


1 ^ 


(3-43) 


(3-44) 


What  these  equations  state  Is  that  the  overall  recovery  probabilities  In  states  Sg  and  S i are 
weighted  sums  of  the  recovery  probabilities  in  the  individual  states  Sg  T;  and  S i T ; , the 
weights  being  proportional  to  the  number  of  victims  in  Sg  T;  and  S i T;  . 

To  illustrate  the  equations,  we  use  the  data  in  our  example. 

Po  = Poi  Pol  P02P02  = (0.98)  (0.77)  + (0.67)  (0.23)  = 0.91 
PI  = PiiPll  + P12P12  = (0.99)  (0.25)  + (0.83)  (0.75)  = 0.87 


I 

|. 
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The  results  stated  in  equations  3-43  end  3-44  ore  exactly  what  we  would  expect;  The  diffi- 
culties ore  coused  by  corresponding  weights  for  states  S©  and  S \ not  being  the  same;  that  is, 

'loi  ^ ^ li  • ° result,  certain  recovery  probabilities  po;  get  weighted  more  heovily  in  the 

calculation  of  pp  than  do  the  corresponding  recovery  probabilities  pi;  in  the  calculation  of 
Pi  , and  conversely.  This  is  how  apparent  anomalies  can  occur,  such  as  hoving  the  overall 
recovery  probability  for  victims  using  PFDs  less  than  for  victims  not  using  PFDs. 

We  will  not  attempt  to  give  a completely  general  answer  to  the  second  posed  question  on  how 
to  calculote  benefits,  but  will  consider  insteod  a special  case,  namely  one  In  which  a 
contemploted  regulation  is  designed  to  transfer  accident  victims  from  state  Sp  to  state  S i , 
but  will  not  tronsfer  victims  between  any  T-states.  That  is,  we  only  will  consider  how 
benefits  ore  to  be  calculated  when  victims  are  transferred  from  state  Sp  T;  to  Si  T;  , 1 < i < n. 

In  such  a case  benefits  moy  be  colculated  separately  for  each  transfer,  from  Sp  T;  to  S i T;  , 
and  the  results  summed  to  arrive  at  the  overoll  expected  benefit  B.  In  particular,  if  r;  , 

1 < i < n , is  the  transfer  rate  (froction)  of  victims  transferred  from  Sp  T;  to  S i T;  , then  the 
overoll  expected  benefit  is  given  by: 

o B = (ri  bi)  (pii  - ppi)  + (r2  b2)  (pi2  - pp2)  + ...  + (rn  bp,)  (pi  n - POn) 

n (3-45) 

= (n  b;)  (pii  - Poi) 

i = 1 

To  illustrote  with  our  example,  suppose  a contemplated  educotional  program  is  designed  to 
cause  30%  of  those  adults  who  would  not  otherwise  use  a PFD  in  an  accident  to  use  one,  and 
to  couse  50%  of  the  children  who  would  not  otherwise  use  a PFD  to  use  one.  Then  ri  = 0.30 
and  r2  = 0.50  and  the  benefit  of  this  program  would  be: 

B = (ri  bi)  (pii  - ppi  ) + (r2  b2)  (pi2  - P02) 

= (0.30)  (1000)  (0.99  - 0.98)  + (0.50)  (300)  (0.83  - 0.67) 

= 27  lives  saved  . 

We  now  turn  to  our  third  question  concerning  when  other  factors  must  be  taken  into  account 
ond  when  they  may  be  safely  ignored.  While  further  research  may  yield  additional  criteria, 
the  following  two  criterio  furnish  good  guidelines  to  when  states  may  be  combined. 
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(a) 


If  the  recovery  probabilities  in  states  SqT|  and  SqTj  are  equal,  the  recovery 
probabilities  in  states  S j T|  and  S i T • are  equal  and  the  transfer  rates  are 
the  same,  then  states  Tj  and  Tj  may  be  combined. 


(b) 


If  the  fraction  of  victims  in  state  T;  who  are  in  state  Sq  is  the  same  as  the 
fraction  of  victims  in  state  Tj  who  are  in  Sq  / and  the  transfer  rates  are  the 
same,  then  states  Tj  and  Tj  may  be  combined, 


The  mathematical  equivalent  of  criterion  (a)  is: 


o Pot  = Poj  / Pli  = Plj  and  r;  = rj  (3-46) 

Criterion  (b)  may  , ? expressed  mathematically  in  the  following  three  equivalent  forms: 


Poi 

917 


qo] 


qi 


and  r 1 = r 1 


b : 


bi  +d( 


^TTJj 


and  rj  = r j 


(3-47) 

(3-48) 


b • b • 

= -j-  and  r ; = r . 
d;  dj  ' J 


(3-49) 


Note  that  criterion  (a)  cannot  be  replaced  with  the  more  general  condition  p li  - poi  = 

P 1 1 " Po  j and  r j = r j . We  illustrate  this  with  an  example.  Let  rj  = r j = 0.1,  and  consider 
the  data  aj  = 100,  bj  = 200,  cf  = 20,  dj  = 30,  aj  = 90,  bj  = 120,  cj  = 110  and  d j = 120. 


Now  Pli  - Poi  = ^ - ^ = 0.17  and  p,j  “ Poj  = ^ “ 0.17,  so  the  more 


general  condition  is  satisfied.  Using  3-45  to  calculate  benefits,  we  hove  B = (0.1)  (200)  (0.17) 
(0.1)  (120)  (0.17)  =5.44.  But  if  we  combine  states  and  colculate  benefits  we  obtain 


B=(0.t)  (320)(|^“  - =8.73. 


To  illustrate  criterion  (b),  we  again  consider  a PFD  example,  but  one  including  both  age 
ond  sex.  Suppose  accident  victims  are  divided  by  age,  sex  and  PFD  use  as  indicated  in 
the  following  table. 


I 4 
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T, 

Male 

Adults 

T2 

Female 

Adults 

T3 

Male 

Children 

T4 

Female 

Children 

= 0 97 

150 

= 1.00 
30 

1 

S , (PFD  use) 


Suppose  r)  = 0.20,  X2  ~ 0.40,  T3  = 0.60,  and  - 0.60 


We  will  illustrate  that,  because  the  second  criterion  applies  (approximately)  to  states  T 3 and 
T4  , they  may  be  combined  into  the  single  state  "children." 

First,  let  us  calculate  benefits  using  all  four  states  T^,T2,T3,T4: 

B = (0.20)  (850)  (0.99  - 0.98)  + (0.40)  (150)  (1 .00  - 0.97)  ^ (0.60)  (167)  (0.79  - 0.69) 
+ (0.60)  (100)  (0.90  - 0.63) 

= 30  lives  soved  . 

Now,  we  show  that  criterion  (b)  is  met.  Although  it  is  only  necessary  to  check  one  of  equations 
3-47,  3-48,  and  3-49,  we  will  check  all  three  to  Illustrate  the  various  values: 


- = 


T ' 1267 


= 0.132 


Testing  3-47, 

9 0 3 _ ^ ^ = 0 277 

i73  - 0.476 

I q Oi  _ 0.0789  _ 
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Since  these  values  are  approximately  equal,  the  criterion  is  approximately  satisfied  and 
T 3 and  T4  may  be  combined. 

Similarly,  we  could  check  equation  3-48,  finding: 

b3  = 167  ^ 

b3  + d3  167  + 260 

j _ 100  _ ^ 

" 100'*T20  ■ • 

Finally,  to  check  equation  3-49,  we  would  examine: 


d 200 


= 0.835 


again  obtaining  approximate  equality. 


Combining  stotes  T 3 ond  T4  we  obtain  the  state  T 3 (children)  and  the  following  data  table. 


Ti 

(Male  Adults) 

Tz 

(Female  Adults) 

T* 

' 3 

(Children) 

OOl  00 

II 

0 

^lO' 
o|  0 

II 

0 

I.OO 

^ - 0 83 
320 

So  (PFD  non-use)  |^  = 0.98  ^ = 0.97  ^ = 0.67 

s.  ^=0.99 

Calculating  benefits  using  this  table,  with  r ) = 0.20,  r2  = 0.40,  and  r*  = 0.60,  we  have: 

B=  (0.20)  (850)  (0.99  - 0.98)  + (0.40)  (150)  (1.00  - 0.97)  + (0.60)  (267)  (0.83  - 0.67) 
= 29  lives  saved  . 


The  one  life  difference  between  this  calculation  and  the  previous  one  is  due  to  rounding  error 
ond  the  foct  that  the  criterion  was  only  approximately  met. 

The  condition  in  criteria  (a)  and  (b)  that  the  transfer  rates  r;  and  r j be  equal  may  be  able  to 
be  relaxed  in  certain  cases  if  a cambined  transfer  rate  r can  be  determined  which  has  the 
same  effect. 
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Of  course,  all  of  fhe  obove  only  partially  answers  the  question  of  what  factors  need  to  be 
taken  into  occount  in  multi-state  benefit  estimation.  Realistically,  all  possible  factors 
probably  could  not  be  checked  against  criteria  (a)  and  (b).  Furthermore,  criterion  (a)  or  (b) 
would  very  seldom,  if  ever,  be  more  than  approximately  met.  Rnolly,  for  some  factors  the 
states  S]  Tj  , would  contain  no  victims  while  the  state  So  T|  would  contain  victims,  making 
it  necessary  to  assign  a recovery  probability  p on  a judgmental  basis.  In  order  to  choose  the 
factors  (states  T|)  which  would  be  most  important  to  use  in  calculating  benefits,  some  sort  of 
test  is  necessory.  One  possibility  Is  to  use  a Chi-Square  test  on  all  those  factors  which  it  is 
believed  would  be  most  likely  to  violate  both  criteria  (a)  and  (b).  Those  factors  (states) 
which  test  as  having  the  most  significont  differences  with  respect  to  the  equation  terms  in 
both  criteria  (a)  and  (b)  would  be  the  ones  to  use  in  benefit  estimation. 

Once  the  initiol  choice  of  the  states  T;  , 1 < i < n,  is  made,  it  is  advisable  to  use  the  same 
criteria  to  determine  if  it  is  necessary  to  further  divide  any  of  the  states  T;  . Of  course, 
this  could  become  a virtually  endless  process.  Realistic  decisions  must  be  mode  and  careful 
Judgment  used  to  decide  when  sufficient  analysis  has  token  ploce.  Careful  assessment  of  the 
volues  of  the  recovery  probabilities  po|  and  p ij  are  important.  Certainly,  if  negotive  benefits 
are  calculated  in  any  transfer  (a  result  of  pok  > Plk)f  affected  state  Tk  should  be  carefully 
examined,  for  it  may  be  that  transfer  In  that  state  (i.e.,  from  SoT]^  to  5i  Tj^Jis  actually 
detrimental  or  it  may  be  that  the  state  T|^  requires  further  subdivision.  (We  should  mention  at 
this  point  thot  the  benefit  estimation  formulas  included  in  earlier  sections  can  be  used  in 
calculating  negative  as  well  as  positive  benefits.)  If  T |<  contains  relatively  few  victims  it  may 
be  best  to  Just  omit  it  rather  than  attempt  a subdivision  which  likely  would  lead  to  problems 
of  insufficient  dato. 

Once  a final  determination  of  the  states  T;  , 1 < i < n,  is  made,  benefits  can  be  calculated  for 
eoch  transfer  from  Sq  T;  to  S i T;  . If  the  calculations  have  been  mode  on  the  basis  of  dota  for 
reported  victims,  the  methods  of  Section  3.3.2  may  be  used  to  take  unreported  victims  into 
account  in  eoch  So  Tj  to  Si  T;  transfer.  Finally,  as  in  our  PFD  use  examples,  the  separate 
benefits  from  each  transfer  are  summed  to  obtain  the  overall  benefit.  If  error  bounds  ore  used 
to  account  for  unreported  victims,  the  lower  bounds  and  upper  bounds  should  be  summed 
separately  to  obtain  the  overall  bounds. 
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In  case  fhe  reader  has  missed  the  full  significance  of  the  problem  discussed  in  this  section,  we 
point  out  some  of  its  important  aspects:  Survival  probabilities  cannot  be  blindly  used  in 
performing  benefit  calculations.  These  probibilities  are  not  always  what  they  seem  to  be, 
because  their  values  are  affected  by  factors  other  than  ones  directly  under  study.  Thus,  it 
is  possible  for  the  overall  survival  probability  in  state  Sq  to  be  greater  than  in  state  S i , and 
yet  for  S i to  actually  be  a more  desirable  state.  Such  was  the  case  with  the  PFD  use  examples 
of  this  section.  The  reverse  is  also  theoretically  possible.  It  may  be  that  the  overall  survival 
probability  in  state  S j is  greater  than  in  state  Sq  and  yet  S j is  a less  desirable  state  than  is 
So  • Again,  it  is  not  necessarily  true  that  if  p ] ; > po i for  all  i , 1 < i < ^ , then  p j > po  . 

In  order  to  properly  calculate  benefits,  it  is  necessary  to  carefully  select  states  T;  in  order  to 
subdivide  states  Sq  and  S ) into  sub-states  of  the  form  Sq  Tj  and  S i T;  and  to  compute  benefits 
for  transfers  between  these  sub-states.  If  this  subdivision  is  not  performed  in  a careful, 
unbiased  manner,  an  entire  range  of  incorrect  benefit  estimates  could  result.  The  analyst 
must  guard  against  playing  the  game  of  "What  states  T i should  I choose  in  order  to  achieve  a 
reasonable  (i.e.,  desired)  answer?"  While  it  is  perfectly  permissable  and  even  desirable  to 
Judge  the  reasonableness  of  the  result  of  a benefit  calculation,  such  Judgment  should  be  a 
check.  If  this  check  indicates  that  the  results  are  unreasonable,  then  further  analysis  of  the 
problem  con  be  performed.  Hopefully,  further  research  will  result  in  better  understanding  of 
this  problem  and  in  additional  means  of  dealing  with  it. 


In  closing  this  section,  we  mention  the  problem  of  colculoting  benefits  for  two  or  more 
regulations  which  may  have  Interacting  effects.  Level  flotation  regulations  and  PFD  educa- 
tion programs  would  be  an  example.  One  possible  means  of  performing  such  benefit  estima- 
tions would  be  to  perform  the  calculations  sequentially.  For  Instance,  the  results  of  level 
flotation  regulations  could  first  be  estimated  and  new  victim  data  generated  based  on  these 
estimates.  Then,  the  effects  of  PFD  educational  programs  could  be  calculated  using  the  new 
victim  data  generated  from  the  first  benefit  estimation.  Sequential  estimation  in  the  reverse 
order  could  also  be  performed.  Hopefully,  the  results  would  agree. 


46 


Pi  ■ 


' t 


f 

t' 


i 


Even  if  only  one  regulation  is  being  considered,  the  analyst  must  be  careful  to  consider 
possible  side  effects  of  the  regulation.  For  example,  regulation  to  increase  PFD  use  or 
ovallability  might  possibly  result  in  reducing  the  number  of  victims  remaining  with  their 
boats.  Such  side  effects  could  result  in  unexpected  negative  benefits.  Thus,  it  is  important 
that  all  aspects  of  a regulation  be  considered. 

3.4  Forecasting  Benefit  Growth 

In  the  first  phase  of  benefit  prediction,  the  effects  of  a regulation  on  the  factors  ossoclated 
with  Occident  occurrence  ond/or  victim  survival  are  estimated.  The  second  phose  of  benefit 
prediction  uses  the  information  developed  in  the  first  phase  to  make  an  estimate  of  what  benefit 
(accidents  prevented,  lives  saved,  etc.)  would  result  from  the  regulation  if  its  full  effect 
could  be  immediately  felt.  The  third  phase  of  benefit  prediction  adjusts  the  "full  effect" 
estimation  found  in  Phase  2 for  time  effects. 

Phases  1 and  2 were  discussed  in  Sections  3.2  and  3.3.  This  section  is  devoted  to  a discussion 
of  Phase  3.  In  many  respects,  this  is  the  most  difficult  area  in  benefit  estimation  and  assess- 
ment. No  truly  good  methods  of  long-range  quantitative  forecasting  hove  yet  been  developed. 
Even  intermediate  range  forecasts  are  often  inaccurate.  We  need  only  look  at  the  disagreements 
in  expert  economic  opinion  and  at  the  number  of  instances  In  which  such  opinion  has  been 
proven  wrong  to  realize  that  we  should  not  expect  many  benefit  forecasts  to  be  very  accurate. 

In  most  cases,  the  forecasting  problem  in  benefit  prediction  can  be  separated  into  two  related 
components.  The  first  component  odjusts  for  the  implementation  rate  of  the  regulation.  The 
second  component  odjusts  for  chonging  booting  potterns  effecting  Occident  cousotion. 

Each  of  these  components  is  a function  of  time  and  of  foctors,  such  as  social  and  economic 
conditions,  which  themselves  vary  with  time.  Consequently,  for  any  regulation  we  can  express 
both  the  implementation  rate  component  and  the  boating  pattern  component  as  a function  of  the 
single  variable  time. 

If  a new  regulation  requires  a booting  standard  to  be  met,  then  the  implementation  rate  will 
be  o function  of  the  sales  of  new  boats  and  the  retirement  rate  for  old  boats  which  are  of  the 
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type  subject  to  the  regulation.  Data  on  sales  and  retirement  can  be  gathered  in  advance  and 
included  in  a supplementary,  forecasting  data  base. 
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If  a new  regulation  is  actually  an  educational  program,  then  the  implementation  rate  will  be 
based  on  research  specific  to  that  program.  This  research  must  determine  the  rate  at  which 
the  programs'  message  reaches  and  significantly  Influences  boaters. 

The  boating  pattern  component  Is  much  more  difficult  to  determine.  Perhaps  some  accidents 
such  as  falls  overboard  are  directly  proportional  to  the  number  of  hours  of  boater  exposure, 
but  accidents  such  as  two-boat  collisions  are  probably  not.  Thus,  the  boating  pattern  compo- 
nent may  be  very  difficult  to  obtain  for  some  types  of  accidents.  In  such  cases,  a great  deal 
of  expert  judgment  will  be  required. 

Some  very  preliminary  research  has  been  performed  into  applying  forecasting  techniques  to 
CG-357  statistics.  The  results  were  far  from  encouraging.  Further  research  into  the  applica- 
tion of  forecasting  (time  series  analysis)  techniques  is  definitely  needed.  Among  the 
techniques  which  should  be  investigated  are  the  following: 

• Linear  (double)  moving  average 

• Linear  (double)  exponential  smoothing 

• Time  series  decomposition 

• Adaptive  filtering 

• Simple  and  multiple  regressian 

• Census  II 

• Foran 

• Econometric  models 

• Auto  Regressive  Moving  Average  (ARMA)  processes  including  the  Bo  a Jenkins 

method 

• Filters 

The  interested  reader  is  referred  to  Reference  3 for  a general  discussion  of  many  of  these 
techniques . 
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Forecasting  methods  will  also  be  required  in  the  costing  aspect  of  regulatory  effectiveness 
research.  Changes  in  boat  purchasing  patterns  as  well  as  changes  In  material  and  labor  costs 
will  require  forecasting. 

Once  forecasting  methods  have  been  chosen,  the  necessary  saftware  should  be  made  available 
for  use  with  the  data  base  model . Additionally,  a supplementary  data  base  containing  data 
necessary  for  forecasting  (such  as  economic  data,  boot  sales,  weather  data,  etc.)  should  be 
developed  and  Integrated  into  the  main  data  base. 


The  final  result  should  be  a model  which  can  take  the  results  of  research  on  the  expected 
influence  a regulation  will  have  on  accident  or  fatality  causative  factors,  and  determine 
the  future  benefit  of  such  a regulation  as  well  as  the  costs. 
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4.0  BENEFIT  ASSESSMENT 
4.1  IntroducHon 

Benefit  assessment  or  tracking  is  the  process  of  determining  what  benefits  have  accrued  as  the 
result  of  the  promulgation  of  a regulation.  Wyle's  reseorch  into  benefit  assessment  techniques 
concentrated  on  two  general  approaches: 

• comparisons  of  pre-regulation  accident  data  with  post-regulation  doto,  ond 

• comporisons  based  on  post-regulation  accident  data  alone. 

These  approaches  are  discussed  in  Sections  4.1  and  4.2. 

Since  there  is  no  way  of  absolutely  determining  what  would  have  happened  if  a regulation  had 
not  been  oromulgated,  there  is  no  way  of  absolutely  proving  thot  results  obtained  through 
benefit  assessment  methods  are  correct.  For  this  reason,  it  is  highly  desirable  to  hove  available 
o number  of  different  benefit  assessment  techniques  based  on  different  assumptions  so  that  results 
can  be  obtained  by  different  means.  The  closer  the  agreement  between  results  obtained  by 
different  techniques,  the  more  likely  that  the  results  are  reliable. 

Assessing  benefits  in  lives  saved  or  fatalities  prevented  is  in  itself  a difficult  task.  The  task 
of  assessing  benefits  in  terms  of  reductions  in  accidents,  property  damage  and  Injuries  is 
much  more  difficult  as  only  a fraction  of  the  non-fctal  accidents  is  reported,  although  the 
reporting  rate  Is  increasing.  One  of  the  reasons  for  the  increase  is  that  increasingly  many 
insurance  companies  are  sending  Coast  Guard  Boating  Accident  Re,oort  forms  along  with 
insurance  claim  forms  to  boating  accident  victims.  At  this  time,  it  appears  doubtful  if 
sufficiently  accurate  estimates  of  the  total  number  of  non-fatal  accidents  and  associated  injuries 
and  property  damage  can  be  made  to  enable  the  detection  of  benefits  derived  from  any  but  the 
most  effective  regulations.  Thus,  benefit  assessment  analyses  will  probably  be  restricted  to 
fatal  Occident  data,  at  least  in  the  near  future. 
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4,2  Benefit  Assessment  Techniques  Employing  Pre-  ond  Post-Regulotion  Dato 

Benefit  assessment  techniques  which  employ  pre-regulation  as  well  as  post-regulation  Occident 
data  moy  employ  one  or  both  of  the  following  approaches: 

• Using  the  pre-regulation  Occident  data  with,  perhaps,  pre-  and  post-regulation 
dota  on  social,  economic,  weather,  etc.,  patterns  to  project  what  the  current 
accident  pattern  would  have  been  hod  regulations  not  occurred.  The  benefit 

is  then  calculated  as  the  difference  between  this  projected  loss  and  the 
actual  loss. 

• Analyzing  the  pre-  and  post-regulation  data  for  trends  or  changes,  not  reodlly 
expicnable  except  as  a result  of  the  regulation 

Regression  analysis  is  often  used  to  assess  trends  or  to  express  one  variable,  say  number  of 
fatolities,  as  a function  of  another,  soy  number  of  accidents.  While  regression  analysis  can 
be  o powerful  tool,  it  con  also  easily  be  misused.  If  it  is  used,  correlation  coefficients 
certoinly  should  be  calculated  and  statistical  tests  of  the  significance  of  the  coefficients 
should  be  performed.  However,  even  if  such  tests  indicate  significance,  whenever  possible 
the  data  should  also  be  graphed  so  that  the  analyst  can  actually  see  the  variation  on  the  data. 
Appendix  B contains  an  example  of  o regression  analysis  using  real  data  which  illustrates  how 
easily  regression  results  can  be  misinterpreted. 

There  are  a number  of  quantitative  forecasting  techniques  in  addition  to  simple  regression. 

The  reader  is  referred  to  Reference  3 for  a discussion  of  many  of  them.  One  of  the  areas  of 
further  research  in  both  benefit  prediction  and  assessment  should  be  an  in-depth  investigation 
of  the  various  forecasting  techniques  available  so  thot  a determi notion  can  be  made  as  to 
which  is  most  appropriate  for  applicotion  to  boating  accident  data. 

We  now  turn  to  a discussion  of  particular  benefit  assessment  methods.  The  diagram  below  will 
be  useful  in  both  this  and  the  following  section.  The  diagram  separotes  accidents  (or  fatolities, 
etc.)  into  classes  on  the  basis  of  information  obtained  from  the  analysis  of  accident  reports. 
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Suppose  we  are  interested  in  assessing  the  benefit  of  a regulation  promulgated  in  the  past. 

Some  vessels  or  boaters  will  be  in  compliance  with  the  regulation,  while  others  will  not  be. 
Furthermore,  some  accidents  or  fatalities  should  have  been  prevented  as  a result  of  compliance 
with  the  regulation  . Others  theoretically  should  have  been  prevented,  but  for  some  unknown 
reason  were  not  prevented.  Other  accidents  would  have  been  theoretically  preventable  if 
non-complying  boots  had  been  in  compliance.  Rnally,  some  accidents  would  not  be  preventable 
by  compliance;  that  is,  these  accident  occurrences  are  independent  of  compliance.  The 
following  Benefit  Assessment  Diagram  separates  accidents  on  the  basis  just  described. 


Theoretically 

Preventable  Non-Preventable 


BENEFIT  ASSESSMENT  DIAGRAM 
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The  variables  represent  numbers  of  accidents  or  potential  Occident  situations  (situations  which 
would  become  accidents  were  it  not  for  compliance  with  the  provisions  of  the  regulation)  which 
occur  during  some  specified  period  — one  year,  two  years,  etc,  x represents  the  number  of 
potential  accident  situations  which,  because  of  compliance  with  the  regulation,  did  not  become 
accidents.  The  value  of  x Is  unknown;  no  one  reports  non-accidents.  The  variable  y is  the 
number  of  Occidents  involving  complying  boats  which  should  have  been  prevented  by  compliance, 
but  which  for  some  unknown  reoson  were  not  prevented,  z is  the  number  of  accidents  which 
should  have  been  prevented  by  compliance,  but  which  involved  non-complying  boats.  Finally, 
u and  V are  the  numbers  of  Occidents  Involving  complying  and  non-complying  boats  which  hod 
accidents  that  would  not  hove  been  affected  by  compliance;  they  would  have  occurred  whether 
or  not  a boat  complied  with  the  regulation. 

The  determination  of  which  category  each  accident  is  assigned  to  is  made  on  the  basis  of  a 
careful,  structured  analysis  of  the  accident  reports.  This  analysis  should  preferably  be  per- 
formed in  such  a manner  that  the  analysts  do  not  know  if  the  involved  boat(s)  was  in  compli- 
once  until  after  a determination  is  made  as  to  which  classification,  theoretically  preventable 
or  non-preventable,  the  accident  belongs.  The  non-preventoble  accidents  categories  are 
not  necessorily  meant  to  include  all  types  of  non-preventable  accidents,  but  rather  only 
accidents  which  are  related  to  at  least  some  of  the  same  factors  as  are  the  preventable 
accidents.  For  exomple.  If  a regulation  is  designed  to  affect  only  some  collisions  involving 
outboard  boats  less  than  sixteen  feet  (4.9  m)  in  length,  then  it  may  be  preferrable  to  include 
only  collisions  involving  this  type  of  boat  in  the  analysis.  The  determination  of  which 
accidents  to  include  and  which  to  exclude  will  depend  on  a careful  assessment  of  the  assump- 
tions mode  in  the  benefit  calculation  and  on  the  particular  regulation  being  assessed. 

Note  that  data  is  available  on  all  of  the  variobles  except  x.  However,  as  discussed  earlier, 
many  non-fatal  Occidents  are  not  reported  so,  at  least  In  most  Instances,  the  variobles  will 
have  to  be  restricted  to  fatal  accidents. 


We  now  describe  one  benefit  estimation  technique  which  makes  use  of  the  Benefit  Assessment 
Diogram.  Another  technique  making  use  of  this  diagram  is  described  in  Section  4.3. 


ApplIcaHon  of  the  Benefit  Assessment  Diagram:  The  Pre-Post  Technique 


The  Pre-Post  Technique  is  based  on  the  assumption  thot,  for  the  class  of  non-preventable 
accidents  selected: 

• changes  over  time  in  the  number  of  theoretically  preventable  accident 
situations  are  proportional  to  changes  in  the  number  of  non-preventable 
accident  situations. 

In  other  words,  we  wish  to  evaluate  temporal  changes  in  theoretically  preventable  accidents 
by  measuring  chonges  in  non-preventable  accidents. 

The  degree  to  which  this  assumption  will  be  satisfied  depends  upon  how  carefully  the  class  of 
non-preventable  accidents  is  chosen  and  upon  sample  selection  procedures. 

The  assumption  can  be  applied  to  three  classes  of  boats  (or  boaters): 

(i)  all  sampled  boats,  both  complying  and  non-complying, 

(ii)  only  sampled  complying  boats 

(Hi)  only  sampled  non-complying  boots. 

To  describe  the  assumption  in  the  form  of  equations,  consider  two  benefit  assessment  diagrams, 
one  for  a pre-regulation  accident  period  and  one  for  a post-regulation  accident  period. 
Denote  these  diagrams  by  D'  (pre-regulation)  and  D (post-regulation) . Let  x',  y' , z' , u',  v' 
be  the  variables  of  D‘  and  x,  y,  z,  u,  v be  the  variables  of  D. 

Let  k,  k'  and  k"  be  the  following  quotients: 

/.X  t _ X y + z 

• (')  ^ ~ I . ; , — r 

x'  + y'  z 


(in  ><■  = TT/  ' "y' 


(ill)  k"  = ~ 
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For  eoch  of  the  three  boot  classes  listed  obove,  the  assumption  states: 


/•  \ I _ u + V 

• (')  ^ ~ - 1 . ~~i 

u + V 

• (ii)  k'  = -^ 

u 

• (iii)  k"  = -^  . 

V 

Note  that  these  assumptions  (equations)  are  not  equivalent.  It  is  possible  to  have  some  true 
and  some  false.  Also  we  should  expect  in  most  cases  to  have  k"<  k < k'  because  the  number 
of  complying  boats  will  normolly  increase  relative  to  the  number  of  non-complying  boats 
after  the  regulation  is  promulgated. 

Equating  terms  in  the  above  equations  and  solving  for  the  unknown  variobles  x and  x'  yields: 
o (i)  X - kx'  = (y'  +z')  - (y +z)  (4-V 


(ii)  X - k'x'  =(^)  y'  - y 


o Oii)  (4-3) 

The  third  set  of  equations  contains  no  unknown  variables,  but  it  may  be  used  as  a sort  of  test 
to  help  justify  or  refute  the  first  two  equations,  and  thus  partially  justify  or  refute  the  assumption 
at  the  beginning  of  this  section  upon  which  the  Pre-Post  Technique  is  based.  This  may  be  done 
using  a Chi-Square  test  on  the  contingency  table: 


z'  + v' 


Z + z'  V + v'  Z + z'  + V + v' 


A very  lorge  value  of  tends  to  indicote  thot  the  ossumption  is  poorly  sotisfled,  while  a 
very  small  value  tends  to  indicate  that  the  assumption  is  probably  close  to  correct. 

We  may  also  compare  the  onswers  obtained  using  equations  4-1  and  4-2.  If  the  answers  are 
close,  we  have  some  justification  in  believing  them  to  be  valid.  Answers  obtained  by  the 


If 


method  of  Section  4.3  should  also  be  compared  to  answers  obtained  using  equations  4-1  and 
4-2.  The  closer  the  agreement,  the  more  likely  the  answers  are  correct. 

Now,  x'  is  the  unknown  number  of  accidents  prevented  in  the  pre-regulation  period  due  to 
i ndependent  compliance  with  (what  will  become)  the  provisions  of  the  regulation.  The  unknown 
terms  kx'  and  k'x'  cannot  be  eliminated  mathematically  from  equations  4-1  and  4-2.  There 
are,  however,  three  possible  means  of  dealing  with  them: 

(a)  We  might  assume  thot  the  exposure  change  factor  for  actually  preventable 
accident  situations  involving  independently  complying  boats  is  also  k.  Under 
this  assumption,  the  value  of  x - kx'  would  be  the  number  of  accidents 
prevented  due  to  the  regulation  itself  and  not  due  to  independent  compliance. 
We  point  out,  however,  that  there  very  likely  may  be  no  good  justification 
for  making  this  assumption.  (The  same  holds  for  k'x' .) 

(b)  The  Benefit  Assessment  Diagram  method  described  in  Section  4.3  might  be  used 
to  obtain  a value  for  x' . 

(c)  We  could  eliminate  from  consideration  all  independently  complying  boats  in  the 
pre-regulation  period,  in  effect  arbitrarily  setting  x'  = y'  = u'  = 0.  Benefit 
calculations  resulting  from  thie  procedure  would  be  bosed  on  the  assumption  that 
the  proportion  of  boats  in  theoretically  preventable  accident  situations  would  be 
the  same  for  all  boats  after  the  regulation  as  it  was  for  non-complying  boats 
before  the  regulation.  Mathematically, 

X + y z _ z_' 
u + V v'  ‘ 

It  should  be  noted  that  as  kx'  > 0 and  k'x'  > 0 , the  total  benefit  x due  to  compliance, 
either  independently  or  as  a result  of  the  regulation,  will  be  at  least  as  large  as  the  calculated 
values  X - kx'  and  x - k'x' . 

We  now  turn  to  an  example.  A certain  regulation  was  promulgated  in  1971 . The  following 
table  contains  fatality  data  For  two  three-year  periods,  one  ending  two  years  prior  to  the  year 
of  promulgation,  the  other  beginning  two  years  after  the  year  of  promulgation.  (Portions  of 
this  data  are  synthetic.) 
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Fotolify  Totals 


1973  - 1975 


1967  - 1969 


Theoretically  Preventable 


Comply!  ng 


y = 91 


y'  = 159 


Non-Complying 


2 = 170 


2'  = 262 


Non- Preventable 


CompI  yi  ng 


u = 449 


u'  = 266 


Non-Complyi  ng 


v=  193 


v'  = 289 


Z V 

Rrst,  let  us  perform  a contingency  table  test  on  equation  4-3,  p ~ ^ 


170 

193 

363 

262 

289 

551 

432 

482 

914 

For  this  table,  = 0.021,  a very  small  value,  which  encourages  us  to  believe  that  the  answers 
obtained  using  equations  4-1  and  4-2  will  be  close  to  correct. 

Substituting  the  data  into  equation  4-1,  we  obtain: 

^449  + 193^ 


- kx'  = 


(159  +262)  - (91  + 170)  = 226  . 


^266  +289y 

Substituting  the  data  into  equation  4-2,  we  obtain: 

X - k'x'  = (159).  91  = 177  . 

If  we  wish  to  make  the  assumption  under  (a),  this  tells  us  that  about  200  lives  were  saved  due 
to  the  regulation  in  the  period  1973  - 1975.  Even  without  this  assumption  it  appears  that  at 
least  200  lives  were  saved  during  1973  - 1975  as  a result  of  independent  or  required  compliance 
with  the  regulation. 

One  should  not  be  disoppointed  that  the  results  obtained  from  equations  4-1  and  4-2  do  not 
ogree  more  closely.  It  probably  will  be  very  difficult  to  obtain  results  from  different 
calculations  which  do  closely  ogree. 


We  will  return  to  this  example  in  the  next  section. 
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4.3  Benefif  Assessment’  Techniques  Employing  Single  Period  Data 

In  Section  4.2  we  derived  equations  for  calculating  benefit  values  based  on  an  assumption 
concerning  the  relationship  between  pre-  and  post-regulation  periods  and  preventable  and 
non-preventable  accidents.  In  this  section  we  again  use  the  Benefit  Assessment  Diagram  to 
assess  regulatory  benefits.  We  will  call  the  method  employed  the  Compliance  Technique.  It 
is  based  on  the  following  assumption: 

• The  fact  of  boot  compliance  or  non-compliance  does  not  affect  the  relative 
chance  of  a boat  being  in  a theoretically  preventable  accident  situation 
versus  a non-preventable  accident  situation. 

This  assumption  may  be  restated  as: 

• In  any  period,  the  odds  of  a boat  (or  boater)  being  in  a theoretically  preventable 
accident  situation  versus  a non-preventable  accident  situation  are  the  same  for 
complying  boats  as  for  non-complying  boats. 

This  assumption  is  much  more  likely  to  be  satisfied  in  Instances  of  equipment  compliance  rather 
than  of  boater  action  compliance.  If  boater  decision-making  is  related  to  compliance,  then  it 
is  likely  that  compliance  is  not  independent  of  the  presence  of  a potential  accident  situation, 
thus  negating  the  assumption.  This  would  occur,  for  instance,  in  the  case  of  PFD  use,  where 
the  use  of  PFDs  would  be  related  to  boater  characteristics  and  the  environment  in  which  a 
boater  is  located  (see  Section  3.3.3). 

The  assumption  may  be  expressed  os  the  equation: 

X + y _ u 
Z V 

or  equivalently. 
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As  before,  x is  the  total  benefit  due  to  compliance,  whether  the  compliance  is  independent 
(voluntary)  or  is  involuntary  (directly  due  to  legal  requirements  imposed  by  the  regulation). 

The  ossumption  should  not  be  taken  to  mean  that  complying  boats  are  assumed  to  be  in  imminent 
danger  of  having  o theoretically  preventable  accident,  but  rather  that  they  will  be  found 
operating  in  the  same  general  conditions  as  non-complying  boats. 

As  with  the  Pre-Post  Technique,  careful  Judgment  has  to  be  used  in  the  choice  of  the  non- 
preventable  accident  class  and  in  the  sample  selection  process.  Also  as  before,  during  the 
Occident  analysis  process,  the  determination  of  whether  an  accident  is  or  is  not  theoretically 
preventable  must  be  made  independently  of  a knowledge  of  whether  or  not  a boat  is  in  compliance. 

We  illustrate  this  technique  by  applying  it  to  the  example  of  Section  4.2. 

For  the  three-year,  post-regulation  period  1973-1975, 

X . (H)  z-y 

= (Ji)  070,-9, 

= 304  . 

We  moy  olso  apply  the  technique  to  the  pre-regulation  data: 


X'  = (^)  z-  -y' 

= ( H)  (262) -159 


= 82 


This  value  of  x'  may  be  substituted  into  the  Section  4.2  results: 


- kx'  = 226  and  x - k'x'  = 177  . 


Note  that  k = = 1.16  and  k'  = -^  = = 1.69 

u'  v'  555  u 266 
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Moking  ^he  substityfions  we  obtoin: 


X = 226  +kx'  = 226  +(1.16)  (82)  = 321 
and  X = 177+k'x'  = 177  + (1 .69)  (82)  = 316 

Nofe  that  all  of  our  results  agree  quite  closely:  Compliance,  voluntary  or  involuntary, 
resulted  in  saving  about  315  lives  in  the  three  year  period  1973-1975. 

A Chi-Square  test  can  also  be  applied  to  the  post-regulation  accident  data  to  determine  if 
there  is  a significant  difference  in  accident  patterns  of  complying  and  non-complying  boats. 

The  test  is  applied  to  the  contingency  table 

y u y u 

z V z + V 

y + z u + v y-^z  + u + v 

Using  this  test  and  the  post-regulation  data  of  our  example,  we  obtain  the  table 


91 

449 

540 

170 

193 

363 

261 

642 

903 

and  o highly  significont A'  value  of  93.5. 

We  should  not  expect  to  achieve  this  significant  a result  in  most  cases. 
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5.0  USERS  GUIDE,  CONCLUSIONS  AND  RECOMMENDATIONS 

5 . 1 Users  Guide 


To  help  the  individual  who  wishes  to  rnoke  use  of  the  techniques  developed  in  this  report,  the  1 

following  user's  guide  is  presented  with  steps  outlined  in  the  order  in  which  they  would  most 
likely  be  followed.  The  guide  covers  only  steps  related  to  benefit  prediction  and  assessment. 

Costing  methods  are  not  included. 

It  should  be  emphasized  that  the  procedures  and  techniques  presented  in  this  report  and  outline 
below  are  preliminary  in  nature.  They  will  be  refined  and/or  reploced  with  better  methods 
which  will  be  developed  in  Phase  II  of  this  research  program. 

User's  Guide 

I.  Pre-Regulation 

A.  Develop  data  base  model  following  guidelines  of  Section  2.0  (in  order 
presented) 

B.  Predict  benefits 

1 . Determine  the  cousative  foctors  (states  and  sub-states)  to  be  affected 
by  the  regulation  (Sections  3.1,  3.2,  3.3.3) 

2 Estimate  the  effects  of  the  regulation  on  the  accident  or  recovery 
causative  factors;  i.e.,  determine  transfer  rates  between  states  and 
sub-states  (Section  3.2) 

3.  Make  initial  "full  effect"  benefit  calculations  using  reported  victim  | 

dota  (Section  3.3.1)  | 

^ 4.  Recompute  "full  effect"  benefits  taking  into  account  unreported  accidents 

and  victims  (Section  3.3.2) 

a.  Check  that  taking  unreported  victims  into  account  does  not  result  ] 

! 

in  negative  benefits  (Table  1)  or  benefits  below  an  acceptable  j 

minimum  (Table  2)  (Section  3. 3,2.1) 

b.  Estimate  number  of  and  distribution  of  unreported  victims  and 
calculate  benefits;  or  calculate  error  bounds  (ranges)  of  benefits 
based  on  ronge  esti motes  of  unreported  victims  (Table  3) 

(Section  3. 3.2.2) 
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5.  Combine  benefits  calculated  for  individual  sub-state  transfers 
(Section  3.3.3) 

1 6.  Forecast  benefit  growth  taking  time  factor  into  account  (Section  3.4) 

II.  Post-Regulation 

A.  Determine  the  benefit  assessment  techniques  to  be  used  (Section  4.0) 
j B.  Update  data  base  model  including  data  required  in  the  benefit  assessment 

techniques  chosen  (Sections  2 .0,  4.2) 
j C.  Compute  benefit  assessments  (Sections  4.2,  4.3) 

I D.  Compare  benefit  assessments  obtained  by  different  methods  (Sections  4.2,  4.3) 

E.  Compare  assessed  benefits  with  predicted  ones 

5.2  Conclusions  and  Recommendations 

This  report  includes  the  results  of  initial  research  into  the  development  of  a methodology  which 
the  Coast  Guard  can  use  both  for  assessing  (tracking)  the  results  of  its  past  actions  and  for 
predicting  the  results  of  proposed  actions.  As  explained  in  the  i ntroduction , the  initial 
research  concentrated  on  benefit  prediction  and  assessment.  Future  research  will  have  to  also 
include  the  development  of  methods  for  the  prediction  and  tracking  of  costs. 


The  benefit  estimation  methodologies  presented  in  this  report  should  not  be  considered  as 
sufficient  for  all  estimation  problems.  For  instance,  they  do  not  include  any  means  for  fore- 
costing changes  in  boating  and  accident  patterns,  including,  say,  the  effects  of  implementation 
rates  of  new  construction  standards.  Research  to  determine  appropriate  forecasting  techniques 
to  be  used  in  both  benefit  and  cost  prediction  should  be  pursued.  Certainly  the  problems 
associated  with  multi -state  benefit  estimation  require  further  study  so  that  reasonable  guide- 
lines in  the  use  of  the  multi -state  technique  can  be  developed. 


The  reader  should  be  aware  that  the  benefit  assessment  techniques  developed  in  this  research  do 
not  directly  evaluate  the  part  played  by  boater  decision-making  vis-a-vi  the  existence  of  a 
regulation.  It  is  important  tc  consider  the  effect  of  boater  decision-making  in  any  case  in 
which  it  is  possible  for  such  decision  to  negate  the  intent  of  a regulation.  Boater  decision- 
making can  confound  attempts  at  benefit  assessment  employing  the  usual  techniques.  The  ORI 
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study  (Reference  2)  of  brldge-to-bridge  rodiotelephone  is  probably  on  example.  Ship  operators 
may  only  have  used  bridge-to-bridge  radiotelephones  when  they  thought  they  would  be  of 
benefit.  In  terms  of  our  Benefit  Assessment  Diagram  this  caused  unaccounted  for  transfers  from 
complying  to  non-complying  status  which  made  benefit  assessment  more  difficult.  Some  initial 
research  into  specific  aspects  of  this  problem  has  been  performed  as  part  of  the  PFD  task 
(Reference  2),  where  PFD  use  was  separated  into  a base  use  rate  plus  an  environmental  response 
use  rate.  Additional  research  should  be  performed  with  the  intent  of  developing  more  general 
benefit  assessment  techniques  which  can  account  for  boater  decision-making. 

The  methods  developed  in  this  project  for  assessing  the  benefits  of  past  regulations  are  actually 
rather  primitive.  Further  work  to  develop  more  sophisticated  techniques  is  desirable. 


In  the  area  of  costs  it  should  be  noted  that  while  DOT  has  developed  some  costing  methods  in 
the  area  of  automobile  safety  programs  (Reference  4),  many  of  these  methods  are  not  applicable 
to  the  small  boat  industry  due  to  the  differences  in  size  and  numbers  of  automobile  and  boat 
manufacturers.  General  methods  should  be  developed  for  determining  the  cost  effects  of  Coast 
Guard  boating  safety  program  on  the  boating  industry  (manufacturers,  distributors,  dealers, 
marinas,  services)  and  on  the  boating  public. 

As  boating  activity  patterns,  accident  patterns,  cost  patterns  and  Coast  Guard  regulatory 
actions  are  highly  interrelated  it  is  desirable  to  hove  future  research  consider  all  of  these 
aspects  and  their  interrelationships.  Also,  the  Coast  Guard  is  keenly  aware  that  ill-considered 
regulations  could  have  highly  odverse  effects  on  boaters  and  the  boating  industry.  Consequently, 
further  study  should  include  research  into  the  alternatives  available  and  bounds  on  Coast  Guard 
activities,  taking  into  account  its  desire  to  promote  safe  boating  without  causing  unnecessary, 
adverse  effects.  Such  reseorch  will  necessarily  include  a study  of  the  relationships  between 
possible  Coast  Guard  activities  and  the  patterns  enumerated  above.  In  effect,  it  is  suggested 
that  a systems  approach  be  taken  in  future  regulatory  effectiveness  methodology  research. 
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APPENDIX  A.  DERIVATIONS  OF  BENEFIT  PREDICTION  RESULTS 
In  fhis  appendix  we  derive  the  mathematical  results  presented  in  Section  3.0. 


Suppose  we  hove  two  disjoint  states  So  and  Si  with  b overage  annual  victims  in  Sq  and  d 
average  annual  victims  In  S]  . Suppose  a of  the  victims  in  state  S©  are  survivors  while  c 
of  the  victims  in  state  Si  are  survivors.  Furthermore,  let  x,  a and  ^ be  defined  as  follows: 


X is  the  overage  annual  number  of  unreported  Occident  victims  in  states  So  ond 
S 1 with  a and  yS  being  the  fractions  of  these  victims  in  So  and  S i , respectively. 


Note  that  Of  x is  the  number  of  unreported  victims  in  state  So  , yS  x is  the  number  of  unrep>orted 
vi  cti  ms  i n state  S i , and  a + yS  = 1 . 


Finally,  suppose  that  it  is  estimated  that  when  fully  implemented  a contemplated  regulation 
will  have  the  effect  of  transferring  a fraction  r of  the  victims  in  state  So  to  state  S i . 


The  situation  for  reported  victims  in  states  So  and  S ] may  be  illustrated  schematically  as 
follows: 


a 

c 

b = 

d = P' 

where  po  ond  pj  ore  the  recovery  probabilities  of  victims  in  states  So  and  S j , respectively. 


Simple  olgebraic  manipulations  result  in  the  following  schematic  for  reported  victims  once  the 
regulation  has  been  fully  implemented: 


Reported  Victims;  Full  Implementotion  of  Regulotion 

So  S, 


A-1 


This  diagram  indicates  that  (rb)  victims  are  transferred  to  state  S ] leaving  (1  - r)b  victims  at 
state  $0  . We  assume: 

• All  victims  at  Sq  have  an  equal  probability  of  being  transferred  to  S ] . 

• The  recovery  probability  of  a victim  is  determined  solely  by  his  state's  defining 
criteria,  i.e.,  there  are  no  confounding  interactions. 

These  assumptions  guarantee  that  the  probability  of  recovery  at  state  So  remains  po  after  the 
transfer  and  that  the  transferred  victims  will  hove  a new  probability  of  recovery  of  p i , so  that 
the  recovery  probability  at  Sj  also  remains  unchanged. 

With  these  assumptions  it  should  be  clear  that  (1  - r)a  survivors  remain  at  Sq  and  that  the 
number  of  survivors  at  S i includes  the  original  c survivors  plus  an  additional  p j rb  survivors. 

In  this  simple  model  of  benefit  estimation  we  also  assume  that  there  are  no  changes  in  victim 
numbers  other  than  that  caused  by  the  transfer . 

Calculating  for  reported  victims  only,  the  benefit  Bq  resulting  from  the  regulation  is  the  number 
of  survivors  saved  after  full  implementation  of  the  regulation  less  the  number  of  pre-regulation 
survivors.  Thus, 

Bo  = ( a(l  - r)  + c + p 1 rbj  - (a  + c) 

= a-ar  + c+  pirb-a-c 
= p ] rb  - or 
= r(p  1 b - a) 

= r(pi  b - Po  b) 

= rb(p  1 - Po  ) , 

and  we  have  proven  equation  3-2, 

o Bo  = rb(p  1 - Po  ) . 


A-2 


All  unreporf-ed  victims  are  survivors. 


With  this  assumption  we  can  schematize  the  situation  for  all  accident  victims  in  So  and  Si 
os  follows: 

All  Victims;  Without  Regulation 
So  S 1 


i 

i 


1 

\ 


i 


The  above  expressions  ore  obtained  by  merely  making  the  appropriate  substitutions  (a  + a x for 
o,  etc.)  In  the  corresponding  expressions  for  reported  victims. 

Assuming  a rate  of  transfer  r , the  benefit  6 of  the  regulation  for  all  victims  can  be 
derived  from  3-2  by  making  the  some  substitutions.  Thus,  we  obtoin  equation  3-4, 

o B = B(x,a)  = r(b  + ox)  (p'l  - p'o  ) • 

The  remaining  results  in  Section  3.3  can  be  derived  using  a reexpressed  form  of  this  formulo 
for  B.  Here  ore  the  steps  in  the  derivation. 


= r(b  + o x)  (p'l  - p'o  ) 


= r(b  + O x) 


d+/?x  b-'-Ox 


(d  + ^ 


T ( (b  + O x)  (c  + /?  x)  - (O  + O x)  (d  + ^ x)) 

iS  x)  (b  + ax)  \ ' 
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“ j ^ (bc+b^x  + cax+  ayjx^-ad-ayjx-dax  - 
- j +'"0x  - ad  + [ b/S  ~ ofi  - doe  + cce]  x ) 

“ JT~^  (be  - ad  + [ (b  - q)0  - (d  - c)of  ] x ) 

This  yeilds  equation  3-14, 

o B (be  - ad  + [ (b  - a)yS  - (d  - c)  a ] x ) . 

Eliminating  ^ by  substituting  (1  - oe  ) we  obtain  another  useful  form, 

o B = J+  ()  )x  b-a-(b+d-a-c)ce]  x). 


In  manipuloting  inequalities  it  is  necessary  to  consider  whether  factors  are  positive  or  negative. 
For  reference,  we  now  list  some  basic  inequalities  which  are  true,  either  because  of  the 
definitions  of  the  quantities  involved,  or  because  of  the  assumptions  which  have  been  made, 

0<a<b,b>0 
0<c<d  d>0 

0 < r < 1 

0 < a < 1 

0 < < 1 

X > 0 

We  shall  make  use  of  these  inequalities  without  specific  reference. 

To  obtain  the  results  in  Table  1,  we  must  find  equivalent  forms  of  the  Inequality  p'o  < p'j  . 
Because  B = r(b  + a x)  (p'l  - p'g  ),  p'o  < p'l  is  equivalent  to  B>  0.  Using  equations  3-U 
and  A-l,  this  yields  the  equivalent  inequalities: 

be  - ad  + [ (b  - a) ^ - (d  - c)a]  x > 0 (A-2) 
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and  be - ad  + I b-o-(b+d-a  - c)oi  ] x > 0 (A-3) 

Now,  l-he  tests  in  part  A of  Table  1 are  based  on  the  assumption  that  po  < p i , or  equivalently 
that  ad  < be.  Thus,  using  this  assumption,  we  hove: 

be  - ad  > 0 , 

and  consequently,  inequalities  A-2  and  A-3  will  certoinly  be  sotisfied  if; 

(b  - o);9  - (d  - c)a  > 0 (A-4) 

or,  equivalently, 

b-a-(b+d-a-c)a>  0.  (A-5) 

Inequalities  3-7  is  obviously  equivalent  to  A-4,  while  3-8  is  clearly  equivalent  to  A-5.  Thus, 
if  inequality  3-7  or  3-8  is  satisfied,  the  condition  p'o  < p'l  will  be  met. 

If  the  two  equivalent  inequalities  3-7  and  3-8  are  true  (but  po  > p ] , so  condition  A is  not 
met),  then; 

(b  - a)^  - (d  - c)a  > 0 . 

If  this  inequality  is  strict,  then  we  moy  divide  inequality  A-2  by  (b  - a}^  - (d  - c)a  and 
obtain; 

od  - be 

^ ^ (b  - a)/3  - (d  - c)a  ' 

which  is  inequolity  (3-9). 

Suppose,  on  the  other  hand,  that  inequalities  3-7  and  3-8  are  not  true.  Then,  (b  - a)/S  - 
(d  - c)a  < 0 and  solving  inequolity  A-2  for  x we  obtain: 


1 

2 
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od  - be 

(b  - a)  ;9  - (d  - c)  a 

be  - od 

(d  - c)a  - (b  - a)B 


which  Is  Inequaiify  3-10. 


Rnally,  to  obtain  inequality  3-11,  we  solve  inequality  A-3  for  or  : 

bc-ad+[b-a-(b+d-a-c)ci]x>  0 

[b-a-(b+d-a-c)oelx>  ad - be 
b-a-(b+d-a  - c)a  > (ad  - be)  — 

X 

- (b  - a + d - c)a  > (ad  - be)  ^ - b + a 

(b  - a + d - c)or  < (be  - ad)  — + b - a 

X 

As  all  of  the  inequalities  in  the  above  derivation  are  equivalent,  3-11  is  equivalent  to  A-3, 
and  thus  p'o  < p'i  whenever  3-11  holds.  Note  that  the  derivation  of  3-11  places  no  require- 
ments on  inequalities  3-7  or  3-8. 

Equation  3-13  is  the  equation  of  the  boundary  curve  of  the  region  satisfying  inequality  3-11  . 

It  may  be  derived  from  the  equation  8 = 0,  using  the  same  derivation  as  that  for  inequality  3-11, 
but  with  the  inequality  symbols  replaced  by  equality  (=)  symbols. 

Derivations  of  the  expressions  in  Toble  2 ore  similar  to  these  for  Table  1 . It  is  desired  that  the 

benefit  B be  greater  than  or  equal  to  a minimum  B ; that  is,  B < B . Using  equations  3-14  and 

m m ~ 

A-1,  we  hove  that  B < B is  equivalent  to  both: 
m — 

B < (be  - ad  + [ (b  - a)/3  - (d  - c)or]  x)  (A-6) 

m — a ’’’  p X 

and  B < . - /? r — (be  - ad  + [ b - a - (b  + d - a - c)  a ] x)  (A-7) 

m - d + ( I - a ;x 

We  use  inequality  A-6  to  derive  the  first  expressions  in  Table  2. 
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. _ 


Solving  A-6  for  on  expression  giving  a bound  on  x , we  obfoin: 

(d  + ;3  x)  < r(bc  - od)  + r [ (b  - o);S  - (d  - c)a  ] x 
B d + ;?  B X < r(bc  - od)  + r [ (b  - o)B  - (d  - c)a  ] x 
/SB  x+r[  (d-c)a-(b  - o)/S  ] x < r(bc  - od)  - B d 
(/SB  + r [ (d  - c)Of  - (b  - o)/S  ] )x  < r(bc  - od)  - B d 

Now,  if  os  in  3-15  we  let: 

W=  /SB^+r[(d-c)a-(b  - o)/3  ] , 

then,  the  lost  inequality  becomes: 

Wx  < r(bc  - od)  - B d . 

~ m 

This  expression  is  equivalent  to  A-6  and  hence  is  equivalent  to  B < B.  Furthermore,  if 

m — 

W > 0 this  expression  is  clearly  equivalent  to  3-16  whi  le  if  W<  0 it  is  equivalent  to  3-17. 
Finally,  if  W = 0,  we  have: 

0 < r(bc  - ad)  - B d 
— m 

or  B < 4 (be  - ad) 

m — d 

which  is  inequality  3-18. 

We  hove  thus  completed  the  derivotion  of  the  first  holf  of  Table  2.  To  derive  the  second  half 
of  this  table,  we  use  inequality  A-7,  solving  it  so  as  to  obtain  a bound  on  Of  : 


®m  - d + (l  - a )x  b - a - (b  + d - a - c)a)  x) 

B d + B x-B  xa  < r(bc  -od)+rx(b-a)-rx(b+d-a-c)a 
m m m — 

rx(b  + d-  o-c)0f-B  xOf  < r(bc  - od  + bx  - ax)  - B d - B x 

m — mm 

xl  r(b+d-a-c)-B  ]a<  r(bc  - ad  + bx  - ax)  - B (d  + x)  . 


m 


Now,  if  as  in  3-19  we  let: 

Z = r(b+d-a-c)-B  , 

m 

then  the  lost  inequality  becomes: 

xZ  a < r(bc  - ad  + bx  - ax)  - B (d  + x) 

— m 

or  Za  < — [ r(bc  - ad  + bx  - ax)  - B (d  + x)]  . 

— X m 

This  expression  is  equivalent  to  A-7  and  hence  is  equivalent  to  B^  < B.  It  is  now  clear  that 

inequality  3-20  is  equivalent  to  < B when  Z > 0,  while  inequality  3-21  is  equivalent  to 

B < B when  Z < 0.  In  case  Z = 0,  we  have: 
m — 

0 < - [ r(bc  - od  + bx  - ax)  - B (d  + x)  ] 

— X m 

0 < r(bc  - ad)  + r(b  - a)x  - B d - B x 

— mm 

B X - r(b  - a)x  < r(bc  - ad)  - B d 
m ' — m 

( B - r(b  - a))x  < r(bc  - ad)  - B d (A-8) 

Now,  as  Z = 0, 


0 = r(b+d-a-c)-B 

m 

so  B = r(b  - a)  + r(d  - c) 
m 

and  B - r(b  - a)  = r(d  - c)  . 
m 

Thus,  equation  A-8  is  equivolent  to: 

r(d  - c)x  < r(bc  - ad)  - B d 
— • m 

r(bc  - ad)  - B d 

^ 1 r(d-c) 

which  shows  inequality  3-22  is  equivalent  to  B^  Bin  the  case  where  Z — 0. 
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f I 


We  turn  now  to  equations  3-23  and  3-24.  Equation  3-23  may  be  derived  following  exactly 
the  same  steps  as  were  followed  for  inequality  3-20  with  equality  symbols  replacing  the 
inequality  symbols,  B replacing  B , and  the  condition  Z>  0 ignored. 


Similarly,  equation  3-24  can  he  derived  in  the  same  manner  as  inequality  3-16  with  equality 
symbols  replocing  the  inequality  symbols,  B replacing  B^,  (1  - a ) replacing^,  and  the 
condition  W > 0 Ignored. 

To  obtain  the  inequalities  in  Table  3,  part  A,  is  is  first  necessary  to  demonstrate  the  mono- 
tonicity of  B,  first  as  a function  of  a and  then  as  a function  of  x. 

Equation  A-1  expresses  B in  the  form  suitable  for  differentiation  with  respect  to  a . Using 
this  equation,  we  obtain: 


(d  +(1  - a )x)* 


-rx 


(d  + (1  - a )x  y 


p-  (bc-ad+(  b-a-(b+d-a  - c)a  ] x) 

d + (1  - a )x  ^ J 

(d  + (1  - a )x  ) (b  + d - a - c)  (-x) 

-(bc-ad+[  b-a-(b+d-a  - c)Of  ] x ) (-x) 

bd  + d^  - ad  - cd  + bx  + dx  - ax  - cx 

- a x(b  + d - a - c)  - be  + ad 

- bx  + ax  + a x(b  + d - a - c) 

[ bd  + d^  - cd  + dx  - cx  - be  ] 


-rx 


(d  + (1  - a )x 

-rx 

(d  + 0 - a)x  ) = 


I b(d  - c)  + d(d  - c)  + x(d  - c)  1 


(-rx)  (d  - c)  (b  + d + x) 

(d  + (1  - a )x 

< 0 for  all  admissable  values. 

Thus,  for  any  (fixed)  value  of  x,  x > 0,  B is  a decreasing  * function  of  0(  . 


I 


We  odopt  the  usual  convention  of  defining  decreasing  to  mean  strictly  decreasing  or  constant. 
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I 1 

^ i 

1 

We  now  use  equoHon  3-14  fo  differenHate  B wifh  respect  to  x.  To  simplify  the  expressions,  I 

let  K = (b  - o)y?  - (d  - c)ot  . Equation  3-14  then  becomes: 

B = B(a  ,x)  = ^ (be  - ad  + Kx)  , 

Differentiating  with  respect  to  x we  obtain: 

“ - 
-^B(a,x)  = + 0x  (b<=-ad  + Kx)^ 

= [(d  + /?  x)K  - yj  (be  - ad  + Kx)] 

i (d  + fixf 

' = [ dK  + yS  Kx  - ;9bc  + ySad  - Kx  ] 

(d  +/3x)2 

= [ dK  - y?bc  + /?ad  ] 

(d  + ^x)2 

As  ^ is  positive  for  all  permissable  values  of  x and  a , we  see  that  B is  a monotonic 

, (d+;Sx)2 

function  of  x and  that  the  sign  of  (dK  - be  + ^ ad)  will  determine  whether  B is  increasing  * 

‘ or  decreasing . We  therefore  simplify  this  expression: 

dK  - /9bc  + /Sad  = d [ (b  - a)/S  - (d  - c)a]  - ^bc  + ySad 
= ySbd-/Sad-otd^  + cecd-/Sbc  + /Sad 
= /Sbd-ySbc  + acd-ad^ 

= /9  b(d  - c)  + a d(c  - d) 

= (/Sb  - 0«  d)  (d  - c)  . 

As  d - c > 0,  we  see  thot: 

B is  an  increasing  function  of  x if  and  only  if  /Sb  - ci  d > 0 
and  B is  a decreasing  function  of  x if  and  only  if/Sb  - Cfd<  0. 

* Again,  we  adopt  the  usual  convention,  defining  increasing  to  mean  strictly  increasing 
or  constant. 
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Finally,  note  that  - ad>0is  equivalent  to: 


^ and  to  0«  < ^ , 

while  ^b  - ad<  Ois  equivalent  to: 

B d b 

Thus,  for  any  (fixed)  value  of  Of  , 

0 < a < , B is  an  increasing  function  of  x , 

ond  if  Of  > r-^  , B is  a decreasing  function  of  x . 

To  derive  the  results  of  Table  3 we  use  the  facts  that  for  any  x > 0,  B is  a monotonic  decreasing 
function  of  Of;  for  any  a < ^ , B is  an  increasing  function  of  x;  and  for  any  Of  > ^ ^ ^ , 

B is  a decreasing  function  of  x. 

Let0<  at<a  <02  <l,0<xi<x<X2.  Results  3-25,  3-26  and  3-27  are 
merely  restatements  of  the  above  monotonicity  conditions. 

To  prove  3-28,  suppose  a 2 < ^ ^ • Then: 

B(0f  2,  xi)  < B(a,  xi)  , 

B(0f , X,)  < B(of , x)  < B(a,  X2) 
and  B(0f  , X2)  < B(of  1,  xj)  , 

so  B(a  2,  X 1)  < B(a  , x j)  < B(g  , x)  < B(of , X2)  < B(of  1,  X2)  . 

To  prove  3-29,  suppose  Oj  > • Then: 

B(a  2,  X2)  < B(a , X2)  , 

B(of , X2)  < B(of , x)  < B(a,  xi) 
ond  B(a,  X,)  < B(of  1,  xi)  , 

so  B(a2/  X2)  < B(a,  X2)  < B(a,  x)  < B(a,  xi)  < B(a  1,  xi)  . 


To  prove  3-30,  suppose  ct  \ < r — , < or  2 • Then: 

— b + d — 

B(ct2,  X2)  < 8(Of2,  x) 

B(a2/  x)  < B(or,  x)  < B(a],  x) 
and  B(a  1,  x)  < B(or  i,  X2)  , 

so  B(a2/  ^2)  < B(ct2,  x)  < B(a,  x)  < B(o«i,  x)  < B(ai,  X2)  . 

Turning  to  ports  B.1.  and  B.2(o)  of  Table  3,  note  that  by  definition,  0 < a <1  and 

x>  0.  Furthermore,  it  is  clear  from  equation  3-14  that  B is  continuous  for  all  (ct,  x), 

0 < a < 1,  0 < X.  Thus,  the  choices  ai  = 0,  o«2  = 1 and/or  x = 0 are  all  appropriate 
when  tighter  bounds  are  unavailable. 

The  material  in  part  B.2(b)  is  not  actually  needed,  in  the  sense  that  we  could  always  choose 
os  a volue  for  X2  the  number  of  boaters  in  the  United  States,  or  even  the  population  of  the 
United  States.  The  limiting  process  does,  however,  yield  simplified  expressions  and  can  yield 
quite  tight  bounds  in  some  cases,  os  one  of  the  exomples  illustrotes.  We  therefore  include  it 
as  an  additional  means  of  developing  error  bounds. 

We  define  the  notation  B(ct,oo)  as: 

• B(ct,oo)  = lim  B(o»,  x),  0 < ct  < 1 . 


Equations  3-14  can  be  used  to  evaluate  this  limit.  We  consider  the  following  coses. 
If  Cl  < 1,  then  > 0 and; 

B(a,«)  = lim  , '■  ''g — (bc-ad+[  (b  - a)y3  - (d  - c)a  ] X2  ) 

xr« 

„ r{bc  - ad)  r[  (b  - a)/S  - (d  - c)a]  X2 

' dTjT! 


= 0 + r[  (b  - o)jS  - (d  - c)a]  lim  -3 

^ X2 

= [ (b  - a)/?  - (d  - c)oe] 

P 


•m 


If  Ot  = 1 , fhen  ^ = 0 and: 


B(1,oc)  = lim  ^ (be  - ad  - (d  - c)x2  ) . 

Xj-*X 

Now  if  a = i and  c < d,  then  d - c > 0 and: 

B(1 ,00  ) = - oo  . 

If  Ot  = 1 and  c = d,  then; 

B(I,oo)  = Mm  3 (bd  - ad  - (0)x  2 ) 
d 

= r(b  - a)  . 

This  completes  the  derivation  of  the  results  of  part  B.2.b.  However,  as  a point  of  interest,  we 
also  demonstrate  that  the  expression: 

B(0f  ,oo)  = -^  [ (b  - a);9  - (d  - c)a] 

con  be  used  to  derive  B(l,oo),  provided  B(l,oc)  is  taken  to  mean: 

B(I,oo)  = lim  /3(a,oo)  . 

Q— 1~ 

Calculating  this  limit,  we  have: 

B(I,oo)  = lim  t (b  - a)yg  - (d  - c)a] 

Q—l-  ^ 

= r(b-a)-lim  (d-c)(y^~)  . 

a^i~  ' I - a / 

If  c < d,  then  d - c > 0,  and  as  0 < a < 1 , B(1  ,oo ) = - oo 
If  c = d,  then: 

= r(b  - a)  - lim  (0)  ( ) 

= r (b  - a)  . 

: •mo'^st'otion  is  now  complete. 
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Part  C of  Table  3 is  derived  as  Follows.  The  benefit  B is  given  by  equation  3-4: 


B = B(  a , x)  = r(b  + a x)  (p'l  - p'o  ) . 

If  p’l  > p'o  , this  benefit  is  clearly  non-negative  which  is  the  result  in  C.  i . 

The  result  in  C.2.  can  be  obtained  intuitively  or  mathematically.  Intuitively,  the  largest 
number  of  lives  that  could  possibly  be  saved  under  our  ossumptions  is  the  number  of  victims 
who  are  transferred  to  state  S i who  would  perish  if  they  remained  at  Sq  . This  number  is 
r(b  - a) . 

A/tethematically,  the  largest  benefit  will  occur  when  p']  = 1 . The  benefit  In  this  case  is: 

B = r(b  + a x)  (1  - p'o  ) 

= r(b  + c«x)(l 
= r(b  + ax-a-ax) 


= r(b  - a)  . 


Again,  we  obtain  result  3-35  in  part  C.2. 


To  obtain  the  result  in  part  D of  Table  3,  a mathematical  expression  equivalent  to  the  assump- 
tion that  the  x unreported  victims  are  distributed  between  states  So  and  S j in  the  same  ratio 
as  the  reported  survivors  is  needed.  For  ct  < 1,  the  expression: 


A-15 


= i W(3-f) 

= ~ (rb)  (pi  - Po  ) 

= — Bo  . 

PI 

For  the  case  Ot  = 1,  all  unreported  victims  are  at  state  Sq  • As  the  unreported  victims  are 

distributed  in  the  same  manner  as  the  reported  survivors,  this  means  that  there  are  survivors 

at  $0  and  there  are  no  survivors  at  S j ; that  is,  a > 0 and  c = 0.  Consequently,  po  > 0 and 

p ^ = 0.  This  means  po  > Pi  therefore  Bq  = rb(p  | - po  ) < 0.  We  may  therefore  adopt 

the  convention  — Bo=^Bo  = -oo,  for  Oi  = 1 . 

PI  0 

Continuing  with  the  case  a=  1,  note  that  as  d>  0,  c < d.  Hence,  using  equation  3-33  in 
Table  3,  B(o«  , oo)  = B(1  ,oo)  = - oo  . Thus,  in  the  case  a = 1,  we  may  write: 

B(a  ,co)  = — Bo  . 

P I 

This  equation  was  proven  above  for  ct  < 1 , so  we  now  hove  that  for  any  ot  - value  (0  < ct 
abtained  under  our  assumption. 


Bfa , oo)  = — Bo  . 

P 1 

Combining  our  results,  we  obtain  inequalities  3-36  and  3-37: 

if  PO  < Pi  , fhen  Bo  < B ^ Bq  r 
and  if  Po  > p 1 , *'ben  “Bo<B<Bo  • 


The  only  results  stated  in  the  postscript  to  Section  3. 3.2.2  which  have  not  already  been  proven 
are  the  intuitively  obvious  result  that  including  unreported  victims  (all  survivors)  in  the  calcu- 
lation of  recovery  probabilities  will  cause  the  probabilities  to  increase,  and  the  less  intuitive 
result  that  in  most  cases  the  difference  in  such  probabilities  will  decrease. 

The  first  of  these  results  is  equivalent  to  the  inequality  g < ^ , where  a and  b are  as 
before  and  y is  some  number  of  unreported  victims,  all  survivors.  This  can  be  proven  as  follows. 


I 

i 

\ 

i 

J 

i 

1 

i 
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From  the  definitions,  a < b ; therefore,  os  y > 0,  cy  < by  , 

so  ob  + ay  < ob  + by  , 
o(b  y)  < b(o  + y) 

and  finally, 

a g +y 
b - b +y  • 

While  the  second  result  is  not  true  in  all  circumstances,  it  is  true  under  fairly  general  con- 
ditions. We  will  prove  it  for  the  cose  when  all  survivol  probabilities  are  at  least  one-half. 
The  result  may  be  expressed  mathematically  in  the  notation  we  have  been  using  as: 

if  PO  > f ^ ~ P'l  " P'o  < P 1 “ PC  • 


Now  when 


= - , then  OL  = — ^ and  ^ , 

p c a+c  a+c 


and  the  inequality  p'l  - p'o  < pi  - po  may  be  expressed  as: 


g + c ^ £ _ £ 
ax  — d b ' 


We  will  prove  this  inequality. 

For  convenience,  let  m = — ^ . The  above  inequality  then  becomes: 

a+c 

c + me  o + mg  ^ £ a 

d + mc  b + mo  — d b‘ 

As  all  of  the  denominators  involved  ore  positive,  we  may  "multiply  them  out"  and  simplify, 
obtaining  the  equivalent  inequality: 


abd ^ - a^d^  - ma^cd  - b^cd  + b^c^  + mebe ^ > 0 
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Factoring,  we  obtain  another  equivalent  inequality: 

(be  - ad)  [ be  + ad  + mac  - bd  ] >0,  (A-10) 

but  as  p 1 > po  / 

■§  > 3 , and  be  - ad  > 0 . 
d — b — 

If  be  - ad  = 0,  then  inequality  A-10  is  trivially  satisfied  and  our  desired  conclusion,  A-9, 
is  true . 

If  be  - ad  > 0,  then  inequality  A-10  is  equivalent  to  be  + ad  + mac  - bd  > 0. 

Thus,  we  have  that  for  be  - ad  > 0,  Inequality  A-9  is  equivalent  to: 
be  + ad  + mac  - bd  > 0 . 

Assuming  po  ~ ^ ^ J ^ ^ ^ obtain: 

be  + ad  + mac  - bd  > be  + ad  - bd 

> ad  + ad  - bd 

= (2a  - b)  d 

> 0 

Thus,  A-11  is  true  and  hence  inequality  A-9  is  also  true.  This  completes  the  proof. 

Although  the  condition  ^ ^ ° sufficient  condition  for  the  result  Just  proven  to  hold,  it  is 

not  a necessary  condition.  Indeed,  as  we  saw  in  the  proof,  be  + ad  + mac  - bd  > 0 is  a 
necessary  and  sufficient  condition  provided  g • condition  need  not  always  hold  as 
the  example  below  illustrates. 

t 

Suppose  that  the  number  of  reported  survivors  at  state  Sq  is  10  while  the  total  number  of  | 

reported  victims  at  Sq  is  100.  Suppose  that  the  corresponding  numbers  at  state  S i are  10  and  | 

50.  The  probabilities  of  recovery  at  these  nodes  ore: 
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(A-11) 

■ 


Pc 


0.1 


PI 


0.2  . 


In  Section  3.3.3,  equations  3~38  through  3-42  are  immediate  consequences  of  the  stoted 
definitions.  Equations  3-43  are  also  easily  derivable: 


Equations  3-44  are  derived  in  exoctly  the  same  manner. 

Each  term  (r ; b j)  (p  j ; - Po  j)  of  equation  3-45  is  merely  an  i nstance  of  equation  3-2  for 
calculating  the  benefit  Bi  resulting  from  a transfer  between  states  Sq  T|  and  S i Tj  . Because 
So  and  S)  are  mutually  exclusive  and  the  states  Ti  , ...,  T n are  mutually  exclusive,  no 
victim  can  be  in  more  than  one  of  the  states  So  T , , So  T2  , . . . , S o T „ , S i T i , S i T2  , . . . , 
S ] Tn  . As  a result,  the  benefits  B|  may  be  summed  to  obtain  the  overall  benefit  B.  Thus, 
we  hove  equation  3-45: 


® ®i  ^ X]  (n  bi)  (pi  i - poi)  . 

i = 1 i = 1 { 

-V' 


i 


To  validate  criteria  (a)  and  (b)  it  is  necessary  to  prove  that  under  either  condition: 


^Cj  + c j a;  + a j 


(r;  bj)  (p,i  - POi)  + ''^J  bj)  (pij  -poj)  = r(b;  +bj)  " b;  + bj  ) 


where  r is  the  common  value  r = rf  = rj  , 


c;  + cj 

- is  the  survival  probability  of  the  combined  states  S j Tj  and  S i T j (i  .e , , the  state 


di  +dj 


Sin(T;UTj)),  and 


Oi  +aj 


T- [—  is  the  survival  probability  of  the  combined  states  Sq  T|  and  Sq  Tt  (i  ,e.,  the  state 

bj+b.  J 


SondjUT.)). 

Substituting  for  poi  , pji  , PoJ  / and  pjj  , we  obtain  an  equation  equivalent  to  A-12: 


^cj  ajN 


'c;  + c]  aj  + o] 


We  will  use  equation  A- 13  in  validating  the  criteria. 


Rrst,  suppose  that  criterion  (a)  is  met.  Then  equations  3-46  hold;  that  is, 


Poi  = P0|  / Pli  = PI]  n - '■]  = r . 


Substituting  for  the  probabilities,  we  have: 


a.  <=i  _ <=] 

Ej  di  dj 


Therefore, 


a : = 


l'°\\  , 

a;  I 1 — I and  c • 
\ b;  / J 


= C| 


I 
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Consequently, 


/'‘i'l  Ai' 

c;  + c;  U-i  Oi  +0i  I T- 


\ + bj 


= r(bi  +bj)/^  - ^ 


= rbrf^  - ^1  + rb,(^ 


a (d..dp  ^ (bi+bj) 


bi  + bj 


c!  a; 


J \dj  b| 


Cj  Oj 


and  equation  A-13is  true.  Thus,  if  criterion  (a)  is  met,  the  states  Tj  and  Tj  may  be  combined. 

Turning  to  criterion  (b),  the  statement  of  this  criterion  is  the  same  as  equation  3-48.  We  show 
all  three  equations,  3-47,  3-48  and  3-49  are  equivalent. 


Now,  it  is  easy  to  see  that  the  following  equations  are  all  equivalent: 


bj+dj  bj+dj 

bi  (bj  dj)  = b j (b[  +di) 


b|bj+b;dj  = b|bj+bjdj 


bi  dj  = bjd| 


b.  b. 

d • d • 

I J 


T T 
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(3-47) 


Thus,  we  see  that  equations  3-47  , 3-48,  and  3-49  are  equivalent. 


Now,  to  prove  the  validity  of  criterion  (b),  suppose  It  is  met;  that  is,  suppose  equations 
3-47 , 3-48 , and  3-49  ore  sati  sfi  ed . Let  r = r ; = r j . 


As  3-49  is  true, 

b;  d.  = bj  d; 

so  bjdj+bjdj  = b;d;+bjdi, 
bj  (d|  + d j)  = (bj  + b j)  d; 

and  thus, 

b;  _ b;+bj. 
d ; d J + d J 

We  now  prove  equation  A- 13: 


(A-14) 


! ? 


(using  3-49) 


i- 
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APPENDIX  B.  A LINEAR  REGRESSION  EXAMPLE 

In  this  appendix  we  present  an  example  of  a simple  linear  regression  problem  which  illustrates 
the  care  which  must  be  taken  in  the  use  of  regression. 

Table  B-1  presents  boating  accident  statistics  taken  from  CG-357  for  the  years  1965  through 
1973.  We  determine  a regression  line  for  the  variable  y = annual  fatalities,  agoinst  the 
variable  x = annual  vessels  involved  in  reported  accidents. 

Using  standard  regression  equations  (or,  in  this  instance,  a Texas  Instruments  SR-51A  calcu- 
lotor),  we  determine  the  equation  of  this  regression  line  to  be: 

y = ax  + b = 0. 142x  + 680  . (B-1) 

The  standard  deviations  in  x and  y are: 

Sy  = 605.7  and  Sy  = 147.4  . 


The  coefficient  of  correlation  of  x and  y is  given  by: 
as„ 


r = = 0.582  . 

Sw 


The  unwary  might  proceed  to  use  this  regression  line  without  further  thought.  However,  we 
can  test  the  significonce  of  the  correlotion  coefficient  using  the  t-stotistic: 


r v/n  - 2 

t = , with  n-2  degrees  of  freedom  , 


where  n is  the  number  of  pairs  of  data  points.' 


We  calculate: 

t = 1.894  . 

■*  See  Reference  5 . 
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TABLE  B-1.  RECREATIONAL  BOATING  ACCIDENT  STATISTICS 


Vessels  Involved 

Yeor  Reported  in  Reported  Accidenfs  Reported  Fatalities 


1973 

6738 

1754 

1972 

5044 

1437 

1971 

4915 

1582 

1970 

4762 

1418 

1969 

5239 

1350 

1968 

5427 

1342 

1967 

5274 

1312 

1966 

5567 

1318 

1965 

4778 

1360 

(From  U.S.  Coast  Guard  CG-357  statistical  summaries.) 


1 


As  we  would  expect  o positive  relotionship  between  fatalities  and  vessels  involved  In  accidents, 
' we  test  the  null  hypothesis  r = 0 against  the  one-sided  alternative  r < 0.  A t-test  indicates 

I siginficance  ot  just  obove  the  5%  level,  so  we  should  feel  foirly  safe  in  ossuming  there  is  o 

’ positive  correlation,  right?  Wrong,  Look  at  Rgure  B-1  in  which  the  data  points  are  plotted. 

I If  the  1973  data  point  is  removed,  an  entirely  different  regression  line  is  obtained.  The 

i equation  of  this  line,  based  on  1965  through  1972  data  is: 

y = -0.170x  + 2263  . (B-2) 

j The  corresponding  standard  deviations  and  correlation  coefficient  are: 

J 

s^  = 298.7  , Sy  = 89.4  and  r = -0.569  . 

We  now  see  the  value  of  plotting  the  dota  points.  The  1973  point  is  so  atypical  that  It 
excessively  influences  the  slope  of  the  regression  line. 

This  example  should  illustrate  the  imfjortance  of  plotting  data  points  whenever  possible  and  of 
using  tests  to  determine  if  the  assumptions  underlying  the  regression  are  satisfied.  The  reader 
is  referred  to  References  6 and  7 for  odditional  material  on  regression. 
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FIGURE  B-1.  FATALITIES  vs  VESSELS  INVOLVED  IN  REPORTED  ACCIDENTS  1965-I973 


